-- Logs begin at Fri 2022-08-19 18:16:32 UTC, end at Fri 2022-08-19 19:43:36 UTC. -- Aug 19 19:11:08.754631 dv-osbrick-849019-5-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 19 19:11:08.764183 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 19 19:11:08.775198 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 19:11:08 2022] *** Aug 19 19:11:08.775198 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 19:11:08.775198 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 19:11:08.775198 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: nodename: dv-osbrick-849019-5-ceph Aug 19 19:11:08.775198 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: machine: x86_64 Aug 19 19:11:08.775198 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: clock source: unix Aug 19 19:11:08.775198 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: pcre jit disabled Aug 19 19:11:08.775198 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: detected number of CPU cores: 4 Aug 19 19:11:08.775198 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: current working directory: / Aug 19 19:11:08.775198 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: detected binary path: /usr/bin/uwsgi-core Aug 19 19:11:08.775198 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: your processes number limit is 47680 Aug 19 19:11:08.775198 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: your memory page size is 4096 bytes Aug 19 19:11:08.775198 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: detected max file descriptor number: 2048 Aug 19 19:11:08.775198 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: lock engine: pthread robust mutexes Aug 19 19:11:08.775198 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: thunder lock: enabled Aug 19 19:11:08.775198 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 19 19:11:08.775198 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 19:11:08.820055 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: Python main interpreter initialized at 0x562af912f9c0 Aug 19 19:11:08.820055 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: python threads support enabled Aug 19 19:11:08.820055 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: your server socket listen backlog is limited to 100 connections Aug 19 19:11:08.820055 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: your mercy for graceful operations on workers is 90 seconds Aug 19 19:11:08.820418 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 19:11:08.820493 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: *** Operational MODE: preforking *** Aug 19 19:11:08.820737 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: *** uWSGI is running in multiple interpreter mode *** Aug 19 19:11:08.820737 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: spawned uWSGI master process (pid: 88333) Aug 19 19:11:08.820941 dv-osbrick-849019-5-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 19 19:11:08.823114 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: spawned uWSGI worker 1 (pid: 88346, cores: 1) Aug 19 19:11:08.823114 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: spawned uWSGI worker 2 (pid: 88347, cores: 1) Aug 19 19:11:08.823114 dv-osbrick-849019-5-ceph devstack@keystone.service[88333]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 19:11:13.577120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 19:11:13.577120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: from cryptography.utils import int_from_bytes Aug 19 19:11:13.577829 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 19:11:13.577829 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: from cryptography.utils import int_from_bytes Aug 19 19:11:13.579445 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 19:11:13.579445 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: from cryptography.utils import int_from_bytes Aug 19 19:11:13.579909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 19:11:13.579909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: from cryptography.utils import int_from_bytes Aug 19 19:11:13.629737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 19:11:13.629926 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 19:11:13.630104 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] command line args: [] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 19:11:13.630374 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 19:11:13.630481 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 19:11:13.630579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ================================================================================ {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 19:11:13.630689 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 19:11:13.630814 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] admin_token = **** {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.630895 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] command line args: [] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 19:11:13.631053 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] config_dir = [] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.631170 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 19:11:13.631234 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.631297 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ================================================================================ {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 19:11:13.631429 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] config_source = [] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.631540 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] admin_token = **** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.631640 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] debug = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.631767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.632026 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] config_dir = [] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.632026 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.632141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.632204 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] config_source = [] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.632273 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.632332 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] debug = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.632480 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.632577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.632717 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.632808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.632911 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.632990 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] list_limit = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.633142 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] log_config_append = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.633225 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.633327 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.633411 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.633477 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] log_dir = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.633601 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] list_limit = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.633685 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] log_file = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.633786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] log_config_append = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.633865 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.633971 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.634109 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.634189 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] log_dir = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.634327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] log_file = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.634459 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.634576 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.634668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.634772 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.634876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.634944 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.635003 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.635187 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.635289 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.635405 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.635488 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.635560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.635626 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.635806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.635892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.636052 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.636137 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.636306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.636443 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.636562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.636743 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.636879 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.637029 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.637155 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.637240 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.637322 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.637462 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.637721 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.637805 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.637927 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] publish_errors = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.638141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.638242 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.638373 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.638505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] publish_errors = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.638598 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.638658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.638816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.638916 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.638991 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.639067 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.639239 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.639321 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] standard_threads = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.639461 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.639551 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.639692 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] standard_threads = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.639776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.639878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.639971 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.640072 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] use_journal = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.640178 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.640274 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] use_json = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.640366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.640464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] use_stderr = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.640559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] use_journal = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.640652 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] use_syslog = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.640753 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] use_json = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.640872 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.640990 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] use_stderr = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.640990 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] use_syslog = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.641205 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.641316 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 19:11:13.641503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.641619 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.641730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.641840 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.641951 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.642062 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.642181 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.642292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.642404 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.642514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.642656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.642778 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.642924 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.643039 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.643150 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.643267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.643385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.643503 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.643623 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.643736 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.643847 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.643964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.644076 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.644187 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.644306 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.644418 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.644535 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.644647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.644759 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.644882 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.644994 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.645106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.645217 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.645334 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.645446 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.645566 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.645684 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.645797 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.645908 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.646019 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.646130 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.646249 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.646360 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.646471 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.646597 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.646717 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.646830 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.647023 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.647143 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.647255 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.647367 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.647484 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.647596 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.647715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.647828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.647940 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.648051 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.648161 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.648271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.648390 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.648508 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.648619 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.648730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.648847 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.648960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.649079 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.649192 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.649308 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.649420 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.649531 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.649649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.649769 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.649887 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.650006 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.650119 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.650234 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.650345 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.650496 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.650625 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.650737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.650858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.651006 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.651132 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.651245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.651356 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.651467 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.651578 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.651689 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.651808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.652536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.652664 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.652825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.653100 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.653218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.653218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.653458 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.653572 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.653693 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.653813 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.653934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.654030 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.654124 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.654232 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.654348 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.654460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.654460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.654713 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.654827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.654952 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.655067 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.655180 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.655299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.655413 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.655532 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.655666 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.655863 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.655988 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.656102 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.656221 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.656344 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.656464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.656568 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.656682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.656795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.656915 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.657037 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.657159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.657273 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.657385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.657496 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.657607 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.657724 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.657845 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.657964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.658077 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.658188 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.658301 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.658413 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.658549 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.658664 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.658787 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.658901 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.659020 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.659138 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.659322 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.659439 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.659557 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.659670 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.659782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.659894 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.660014 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.660117 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.660212 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.660313 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.660409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.660503 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.660609 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.660716 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.660812 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.660906 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.661000 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.661093 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.661195 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.661306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.661306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.661496 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.661590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.661691 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.661785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.661887 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.661988 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.662082 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.662182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.662276 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.662369 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.662470 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.662599 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.662696 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.662788 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.662881 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.662981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.666124 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.666230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.666366 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.666479 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.666607 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.666692 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.666773 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.666850 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.666921 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.666991 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.667065 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.667136 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.667214 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.667285 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.667354 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.667424 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.667493 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.667618 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.667738 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.668349 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.668436 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.668508 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.668578 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.668646 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.668646 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] auth.external = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.668782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.668852 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.668920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.668920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] auth.external = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.669051 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.669051 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.669213 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.669302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] auth.password = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.669375 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.669445 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] auth.token = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.669514 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.669583 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.669652 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] auth.password = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.669733 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.669804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] auth.token = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.669881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.669953 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.670028 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.670099 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.670176 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.670249 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.670249 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.670381 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.670453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.670539 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.670539 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] credential.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.670686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.670686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.670813 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.670888 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] credential.caching = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.670958 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.671036 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.671107 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.671177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.671246 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.671315 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.671404 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.671489 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.671560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.671619 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.671687 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.671756 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.671834 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.671905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.671975 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.672044 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.672113 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.672182 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.672263 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.672334 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.672403 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.672472 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.672541 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.672611 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.672755 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.672829 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.672899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.673023 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.673108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] federation.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.673281 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.673368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.673517 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] federation.caching = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.673595 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.673753 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.673830 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.674001 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.674087 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.674243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.674318 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.674473 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.674599 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.674744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.674836 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.674977 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.675054 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.675228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.675305 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.675461 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.675546 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.675705 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.675783 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.675941 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.676019 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.676184 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.676269 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.676429 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.676506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] identity.caching = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.676695 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.676771 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.676942 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.677029 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.677178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.677257 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.677409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.677485 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.677646 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.677731 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.677876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.677959 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.678111 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.678189 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.678350 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.678434 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.678608 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.678690 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.678839 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.678917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.679067 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.679156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.679299 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.679377 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.679542 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.679619 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.679786 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.679870 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.680029 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.680106 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.680279 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.680356 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.680518 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.680596 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.680752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.680829 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.680981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.681058 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.681214 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.681293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.681441 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.681518 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.681674 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.681752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.681901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.681985 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.682135 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.682211 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.682402 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.682488 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.682705 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.682800 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.682911 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.682990 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.683209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.683356 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.683554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.683635 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.683861 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.683937 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.684099 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.684176 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.684347 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.684426 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.684611 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.684704 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.684815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.684892 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.685048 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.685127 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.685281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.685359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.685520 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.685597 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.685754 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.685832 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.686034 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.686112 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.686284 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.686373 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.686572 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.686658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.686777 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.686845 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.687007 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.687126 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.687254 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.687370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.687491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.687604 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.687720 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.687865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.688035 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.688155 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.688253 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.688349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.688445 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.688540 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.688645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.688750 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.688847 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.688944 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.689038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.689134 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.689270 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.689375 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.689512 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.689615 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.689754 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.689858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.689987 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.690352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.690476 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.690610 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.690736 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.690970 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.693661 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.693794 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.693884 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.693954 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.694026 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.694098 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.694181 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.694255 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.694325 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.694395 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.694465 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.694465 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.694683 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.694759 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.694830 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.694900 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.694970 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.695049 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.695122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.695192 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.695262 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.695332 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.695402 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.695481 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.695553 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.695623 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.695693 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.695764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.695834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.695912 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.695985 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.696056 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.696126 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.696196 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.696266 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.696345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.696417 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.696488 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.696558 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.696632 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.696703 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.696846 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.696922 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.696993 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.697065 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.697136 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.697206 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.697284 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.697356 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.697427 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.697497 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.697567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] resource.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.697637 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.697715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.697787 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.697857 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.697928 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.697998 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.698069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.698151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.698224 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.698294 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.698355 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] resource.caching = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.698413 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.698618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.698720 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.698895 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.698982 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.699209 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.699396 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.699548 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.699670 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] role.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.699785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.699898 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] role.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.700039 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.700161 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.700276 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.700397 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.700512 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.700624 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.700737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.700848 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.700960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] role.caching = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.701080 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.701201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] role.driver = sql {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.701317 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.701430 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.701541 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.701653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.701774 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.701888 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.702000 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.702112 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.702224 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.702335 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.702457 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.702642 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.702829 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.702942 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.703056 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.703169 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.703297 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.703415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.703415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.703628 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.703742 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.703863 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.703978 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.704091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.704204 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.704317 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.704430 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.704552 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.704667 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.704780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.704893 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.705007 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.705119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.705240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.705355 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.705468 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.705582 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.705695 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.705798 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.705947 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.706066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.706181 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.706295 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.706409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.706541 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.706672 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.706793 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.706908 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.707020 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.707134 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.707247 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.707369 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.707484 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.707598 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.707712 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.707826 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.707939 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] token.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.708061 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.708175 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.708288 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.708402 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.708516 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.708629 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.708751 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.708865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.708979 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.709092 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.709205 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] token.caching = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.709319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.709441 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.709555 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.709669 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.709783 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.709897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.710009 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.710131 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.710245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.710359 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.710471 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.710616 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.710730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.710856 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.710972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.711075 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.711170 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.711283 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.711379 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.711500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.711615 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.711728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.711843 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.711962 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.connection = **** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.712090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.712214 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.712337 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.712451 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.712565 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.712678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.712790 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.712904 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.713025 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.713139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.713252 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.713365 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.713478 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.connection = **** {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.713600 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.713724 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.713846 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.713963 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.714076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.714189 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.714301 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.714939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.715140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.715263 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.715361 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.715457 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.715553 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.715672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.715873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.715994 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.716109 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.716222 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.716335 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.716448 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.716613 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.716730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.716847 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 19:11:13.716962 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.717138 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.717415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.717652 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.717898 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.718130 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.718369 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.718629 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 19:11:13.718800 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 19:11:13.746289 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.746513 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.746774 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.752414 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.752648 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.757266 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.757392 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.761771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.786077 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.786303 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.788107 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.788338 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.843173 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.843689 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.891465 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.891692 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.893490 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.893726 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.958635 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.958861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.959082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.959299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.959511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.959721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.959805 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.960016 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.960237 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.960453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.960665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.960877 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.987640 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.987777 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.987932 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.988015 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.988155 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.988234 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.988307 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.988425 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.988510 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.988643 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.988726 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.988857 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.988948 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:13.989070 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:14.000466 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:14.000598 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:14.018553 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:14.018777 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:14.018998 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:14.019084 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:14.019237 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:14.019320 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:14.019450 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:14.019540 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:14.019664 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:14.019747 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:14.019880 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:14.019961 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:14.020094 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:14.020303 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 19:11:14.037067 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.037273 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 19:11:14.037557 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.037657 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.037768 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 19:11:14.037850 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 19:11:14.038049 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.038130 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.038292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 19:11:14.038383 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.038568 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.038651 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.038826 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.038906 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.039086 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.039342 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.048306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.048582 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.048853 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.049118 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.049222 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.049395 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.049663 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.049943 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.056015 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.057230 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.059039 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.059330 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.059610 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.059892 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.060177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.060260 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.060437 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.060518 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.060704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.060784 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.060979 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.061061 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.061251 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.061331 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.061508 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.061594 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.061778 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.061858 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.062051 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.062316 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.062623 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.062889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.086784 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.087401 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.088286 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.088570 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.088900 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.089186 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.093969 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.094192 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.094474 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.094877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.095166 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.095451 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.101799 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.102080 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.102615 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.105185 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.106624 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.106918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.107122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.107205 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.107413 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.107498 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.107695 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.107777 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.107977 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.108067 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.108248 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.108356 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.108519 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.108634 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.108916 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.109196 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.124109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.124390 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.127005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.127286 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.128307 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.131139 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.131534 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.131855 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.134340 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.134652 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.136103 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.139696 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.139838 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.142860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.145266 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.145266 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.145266 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.145266 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.145266 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.145266 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.145982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.146280 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.146583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.146982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.147262 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.147540 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.161771 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.162057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.162321 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.162668 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.164638 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.164926 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.165193 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.165455 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.169588 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.171322 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.171601 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.172245 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.173962 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.174240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.174328 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.174556 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.174857 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.175136 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.175410 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.177098 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.177381 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.177664 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.177954 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.178233 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.186726 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.191218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.191218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.191218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.191218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.191218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.191218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.191571 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.191571 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.191571 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.191571 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.191571 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.191571 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.191880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.204424 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.207586 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.207706 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.210503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.210693 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.211958 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.213423 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.214170 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.214253 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.214253 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.215718 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.217245 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.217525 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.217821 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.221107 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.222594 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.224394 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.225413 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.225703 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.225876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.225994 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.226290 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.228936 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.229228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.229510 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.229802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.235196 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.237799 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.237799 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.238004 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.238252 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.238543 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.242639 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.242922 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.243203 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.243481 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.243755 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.244027 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.244323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.244604 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.244876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.245150 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.245419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.245611 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 19:11:14.245735 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.246168 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.246447 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.247109 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.247406 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.247692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.247984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.248466 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.248598 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.248853 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.249139 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.249423 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.249705 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.250005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.250314 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.250605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 19:11:14.280136 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562af912f9c0 pid: 88346 (default app) Aug 19 19:11:14.283620 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a48d3-3ca4-496c-9de4-96246fc92209 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:14.283908 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a48d3-3ca4-496c-9de4-96246fc92209 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:14.284176 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a48d3-3ca4-496c-9de4-96246fc92209 None None] PATH_INFO: `/v3` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:14.285343 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562af912f9c0 pid: 88347 (default app) Aug 19 19:11:14.288286 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 791 bytes} [Fri Aug 19 19:11:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:22.286677 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef86e17-2c33-4a62-9e21-714fa8676e4c None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:22.287280 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef86e17-2c33-4a62-9e21-714fa8676e4c None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:22.287280 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef86e17-2c33-4a62-9e21-714fa8676e4c None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:22.291487 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 1/2] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:22.297531 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7051f-99c1-49be-82c8-c27e50dc022a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:22.297961 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7051f-99c1-49be-82c8-c27e50dc022a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:22.298053 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7051f-99c1-49be-82c8-c27e50dc022a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:22.377088 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: INFO dbcounter [None req-5ba7051f-99c1-49be-82c8-c27e50dc022a None None] Registered counter for database keystone Aug 19 19:11:22.398178 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG oslo_db.sqlalchemy.engines [None req-5ba7051f-99c1-49be-82c8-c27e50dc022a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 19:11:22.404595 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writer thread running {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 19:11:22.584931 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG passlib.handlers.bcrypt [None req-5ba7051f-99c1-49be-82c8-c27e50dc022a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88346) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 19:11:22.585355 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG passlib.handlers.bcrypt [None req-5ba7051f-99c1-49be-82c8-c27e50dc022a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88346) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 19:11:22.640330 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-5ba7051f-99c1-49be-82c8-c27e50dc022a None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:22.641947 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5ba7051f-99c1-49be-82c8-c27e50dc022a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:22.769991 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 19 19:11:23.272106 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef86e17-2c33-4a62-9e21-714fa8676e4c None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:23.350160 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: INFO dbcounter [None req-4ef86e17-2c33-4a62-9e21-714fa8676e4c None None] Registered counter for database keystone Aug 19 19:11:23.369114 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG oslo_db.sqlalchemy.engines [None req-4ef86e17-2c33-4a62-9e21-714fa8676e4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 19:11:23.375866 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writer thread running {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 19:11:23.493384 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef86e17-2c33-4a62-9e21-714fa8676e4c None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:23.498322 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd3fc3-6040-47af-80f0-140bbe11fec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:23.498978 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd3fc3-6040-47af-80f0-140bbe11fec6 admin admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:23.499263 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd3fc3-6040-47af-80f0-140bbe11fec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:23.499537 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd3fc3-6040-47af-80f0-140bbe11fec6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:23.507678 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd3fc3-6040-47af-80f0-140bbe11fec6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:23.559609 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ebbd3fc3-6040-47af-80f0-140bbe11fec6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 19:11:23.559948 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd3fc3-6040-47af-80f0-140bbe11fec6 admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:23.570249 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1324 bytes} [Fri Aug 19 19:11:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 19:11:23.576848 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7051f-99c1-49be-82c8-c27e50dc022a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:23.593645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7051f-99c1-49be-82c8-c27e50dc022a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:23.598347 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03871c63-3b6e-40c5-80c8-9656635d5895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:23.603208 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03871c63-3b6e-40c5-80c8-9656635d5895 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:23.603208 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03871c63-3b6e-40c5-80c8-9656635d5895 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:23.603208 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03871c63-3b6e-40c5-80c8-9656635d5895 admin admin] PATH_INFO: `/v3/projects/1351328a9fb54f3696993b85a91b70f8` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:23.603208 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03871c63-3b6e-40c5-80c8-9656635d5895 admin admin] RBAC: Authorizing `identity:get_project(project_id=1351328a9fb54f3696993b85a91b70f8)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:23.652228 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: WARNING keystone.common.rbac_enforcer.enforcer [None req-03871c63-3b6e-40c5-80c8-9656635d5895 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 19:11:23.652705 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03871c63-3b6e-40c5-80c8-9656635d5895 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:23.657319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 3/5] 10.222.0.61 () {56 vars in 1207 bytes} [Fri Aug 19 19:11:23 2022] GET /identity/v3/projects/1351328a9fb54f3696993b85a91b70f8 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:25.821498 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbc2a6-4eff-4681-9607-ae1a3df4c1ae None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:25.822026 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbc2a6-4eff-4681-9607-ae1a3df4c1ae None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:25.822026 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbc2a6-4eff-4681-9607-ae1a3df4c1ae None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:25.826350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 3/6] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:25.831643 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3a89c-65b5-4c6f-8c1f-23bbd7d2a189 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:25.832023 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3a89c-65b5-4c6f-8c1f-23bbd7d2a189 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:25.832194 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3a89c-65b5-4c6f-8c1f-23bbd7d2a189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:25.852417 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-3ab3a89c-65b5-4c6f-8c1f-23bbd7d2a189 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:25.853925 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3ab3a89c-65b5-4c6f-8c1f-23bbd7d2a189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:25.862625 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 4/7] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 19:11:26.189321 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbc2a6-4eff-4681-9607-ae1a3df4c1ae None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:26.202321 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbc2a6-4eff-4681-9607-ae1a3df4c1ae None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:26.206749 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c8fdb-71e0-4508-8159-220017b1b0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:26.207348 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c8fdb-71e0-4508-8159-220017b1b0ec admin admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:26.207632 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c8fdb-71e0-4508-8159-220017b1b0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:26.207908 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c8fdb-71e0-4508-8159-220017b1b0ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:26.217205 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c8fdb-71e0-4508-8159-220017b1b0ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:26.219066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c8fdb-71e0-4508-8159-220017b1b0ec admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:26.228098 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1324 bytes} [Fri Aug 19 19:11:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 19:11:26.234018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3a89c-65b5-4c6f-8c1f-23bbd7d2a189 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:26.243790 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3a89c-65b5-4c6f-8c1f-23bbd7d2a189 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:26.248414 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0119c-2948-4629-ab80-d011c6f28728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:26.249051 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0119c-2948-4629-ab80-d011c6f28728 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:26.249324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0119c-2948-4629-ab80-d011c6f28728 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:26.249607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0119c-2948-4629-ab80-d011c6f28728 admin admin] PATH_INFO: `/v3/users/7ffe86579b7344d19702549b20bcc927` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:26.250957 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0119c-2948-4629-ab80-d011c6f28728 admin admin] RBAC: Authorizing `identity:get_user(user_id=7ffe86579b7344d19702549b20bcc927)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:26.254073 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0119c-2948-4629-ab80-d011c6f28728 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:26.254327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 5/9] 10.222.0.61 () {56 vars in 1198 bytes} [Fri Aug 19 19:11:26 2022] GET /identity/v3/users/7ffe86579b7344d19702549b20bcc927 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:28.519999 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f1e19-4a21-4896-a383-97607e25c76e None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:28.520566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f1e19-4a21-4896-a383-97607e25c76e None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:28.520566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f1e19-4a21-4896-a383-97607e25c76e None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:28.521868 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 5/10] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:28.528072 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529105db-695d-476d-b049-8acd444e4395 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:28.528483 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529105db-695d-476d-b049-8acd444e4395 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:28.528623 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529105db-695d-476d-b049-8acd444e4395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:28.540179 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850bb31-edb7-4744-bf37-875d9a4c456e None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:28.540467 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850bb31-edb7-4744-bf37-875d9a4c456e None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:28.540746 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850bb31-edb7-4744-bf37-875d9a4c456e None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:28.542039 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 6/11] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:11:28.547100 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-529105db-695d-476d-b049-8acd444e4395 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:28.547227 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191d08d-baf4-4d2a-b43f-99f8c18c8573 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:28.547379 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191d08d-baf4-4d2a-b43f-99f8c18c8573 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:28.547652 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191d08d-baf4-4d2a-b43f-99f8c18c8573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:28.548297 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-529105db-695d-476d-b049-8acd444e4395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:28.590290 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG passlib.handlers.bcrypt [None req-e191d08d-baf4-4d2a-b43f-99f8c18c8573 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88347) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 19:11:28.590729 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG passlib.handlers.bcrypt [None req-e191d08d-baf4-4d2a-b43f-99f8c18c8573 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88347) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 19:11:28.637214 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-e191d08d-baf4-4d2a-b43f-99f8c18c8573 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:28.638885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-e191d08d-baf4-4d2a-b43f-99f8c18c8573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:28.741780 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:11:28.745904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:11:29.071531 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529105db-695d-476d-b049-8acd444e4395 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:29.075441 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191d08d-baf4-4d2a-b43f-99f8c18c8573 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:29.096420 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:29.175670 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191d08d-baf4-4d2a-b43f-99f8c18c8573 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:29.175886 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529105db-695d-476d-b049-8acd444e4395 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:29.178018 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:29.210653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cd6d5-010b-493d-952f-a03558494924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:29.211270 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cd6d5-010b-493d-952f-a03558494924 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:29.211556 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cd6d5-010b-493d-952f-a03558494924 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:29.211837 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cd6d5-010b-493d-952f-a03558494924 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:29.214516 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc6929-84b3-46f3-9e12-d4429c487a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:29.215697 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc6929-84b3-46f3-9e12-d4429c487a2b None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:29.215978 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc6929-84b3-46f3-9e12-d4429c487a2b None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:29.216246 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc6929-84b3-46f3-9e12-d4429c487a2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:29.227948 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc6929-84b3-46f3-9e12-d4429c487a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:11:29.238399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-50cc6929-84b3-46f3-9e12-d4429c487a2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:11:29.238399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:11:29.238399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:11:29.238399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:11:29.238399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:11:29.238399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:11:29.238399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:11:29.238399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:11:29.238399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:11:29.238399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:11:29.238399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:11:29.238399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:11:29.238399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:11:29.238399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:11:29.238399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:11:29.238399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:11:29.239409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:11:29.239409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:11:29.239409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:11:29.239409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:11:29.239409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:11:29.239409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:11:29.239409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:11:29.239409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:11:29.239409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:11:29.239409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:11:29.239409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:11:29.239409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:11:29.239409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:11:29.239409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:11:29.239409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:11:29.239409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:11:29.240228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:11:29.240228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:11:29.240228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:11:29.240228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:11:29.240228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:11:29.240228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:11:29.240228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:11:29.240228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:11:29.240228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:11:29.240228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:11:29.240228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:11:29.240228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:11:29.240228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 8/14] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Aug 19 19:11:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:11:29.245248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc6929-84b3-46f3-9e12-d4429c487a2b None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:29.282872 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4cd6d5-010b-493d-952f-a03558494924 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:29.284254 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4cd6d5-010b-493d-952f-a03558494924 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:29.308625 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:29.343335 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc6929-84b3-46f3-9e12-d4429c487a2b None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:29.378127 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8ca91-6bfc-44bc-90ab-111a9c3f89f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:29.378806 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8ca91-6bfc-44bc-90ab-111a9c3f89f4 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:29.379089 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8ca91-6bfc-44bc-90ab-111a9c3f89f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:29.379357 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8ca91-6bfc-44bc-90ab-111a9c3f89f4 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:29.380020 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8ca91-6bfc-44bc-90ab-111a9c3f89f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:29.380320 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8ca91-6bfc-44bc-90ab-111a9c3f89f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:29.381743 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8ca91-6bfc-44bc-90ab-111a9c3f89f4 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:29.385308 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 7/15] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:11:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:11:29.391399 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cd6d5-010b-493d-952f-a03558494924 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:29.394296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 9/16] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:11:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:29.399880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8ca91-6bfc-44bc-90ab-111a9c3f89f4 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:29.427534 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:29.491817 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cd6d5-010b-493d-952f-a03558494924 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:29.499603 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8ca91-6bfc-44bc-90ab-111a9c3f89f4 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:29.514304 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:29.525814 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f7f24-996a-47df-a127-1c9aab616f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:29.526458 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f7f24-996a-47df-a127-1c9aab616f0b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:29.527307 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f7f24-996a-47df-a127-1c9aab616f0b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:29.527587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f7f24-996a-47df-a127-1c9aab616f0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:29.534357 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff914fe5-afc0-45c2-b55b-4d1f2337cf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:29.535070 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff914fe5-afc0-45c2-b55b-4d1f2337cf8b None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:29.535285 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff914fe5-afc0-45c2-b55b-4d1f2337cf8b None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:29.535553 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff914fe5-afc0-45c2-b55b-4d1f2337cf8b None admin] PATH_INFO: `/v3/users/7ffe86579b7344d19702549b20bcc927` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:29.537033 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff914fe5-afc0-45c2-b55b-4d1f2337cf8b None admin] RBAC: Authorizing `identity:get_user(user_id=7ffe86579b7344d19702549b20bcc927)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:29.538482 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff914fe5-afc0-45c2-b55b-4d1f2337cf8b None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:29.539814 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f7f24-996a-47df-a127-1c9aab616f0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:29.540674 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 10/17] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:11:29 2022] GET /identity/v3/users/7ffe86579b7344d19702549b20bcc927 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:29.541522 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f7f24-996a-47df-a127-1c9aab616f0b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:29.546994 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff914fe5-afc0-45c2-b55b-4d1f2337cf8b None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:29.561348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-2a2f7f24-996a-47df-a127-1c9aab616f0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:11:29.561348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:11:29.561348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:11:29.561348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:11:29.561348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:11:29.561348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:11:29.561348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:11:29.561348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:11:29.561348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:11:29.561348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:11:29.561348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:11:29.561348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:11:29.561348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:11:29.561348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:11:29.561348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:11:29.561348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:11:29.562231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:11:29.562231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:11:29.562231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:11:29.562231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:11:29.562231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:11:29.562231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:11:29.562231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:11:29.562231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:11:29.562231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:11:29.562231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:11:29.562231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:11:29.562231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:11:29.562231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:11:29.562231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:11:29.562231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:11:29.562231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:11:29.562231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:11:29.563068 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:11:29.563068 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:11:29.563068 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:11:29.563068 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 8/18] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:11:29.568401 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f7f24-996a-47df-a127-1c9aab616f0b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:29.653054 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:29.659235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff914fe5-afc0-45c2-b55b-4d1f2337cf8b None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:29.670400 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f7f24-996a-47df-a127-1c9aab616f0b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:29.693440 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbc6ec-0e3e-42ef-84a1-f5ced9dbf3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:29.694080 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbc6ec-0e3e-42ef-84a1-f5ced9dbf3f9 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:29.694357 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbc6ec-0e3e-42ef-84a1-f5ced9dbf3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:29.694662 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbc6ec-0e3e-42ef-84a1-f5ced9dbf3f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:29.695776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbc6ec-0e3e-42ef-84a1-f5ced9dbf3f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:29.697226 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbc6ec-0e3e-42ef-84a1-f5ced9dbf3f9 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:29.699041 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 11/19] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:11:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:29.704560 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbc6ec-0e3e-42ef-84a1-f5ced9dbf3f9 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:29.708503 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b76169-b89b-4cff-95ab-a734fc962208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:29.712875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b76169-b89b-4cff-95ab-a734fc962208 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:29.712875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b76169-b89b-4cff-95ab-a734fc962208 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:29.712875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b76169-b89b-4cff-95ab-a734fc962208 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:29.714864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b76169-b89b-4cff-95ab-a734fc962208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:29.714864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b76169-b89b-4cff-95ab-a734fc962208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:29.716486 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b76169-b89b-4cff-95ab-a734fc962208 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:29.736946 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 9/20] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:29.941146 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbc6ec-0e3e-42ef-84a1-f5ced9dbf3f9 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:29.975943 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82681e07-49eb-4194-a7e2-ed821cd38597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:29.976593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82681e07-49eb-4194-a7e2-ed821cd38597 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:29.976872 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82681e07-49eb-4194-a7e2-ed821cd38597 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:29.977149 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82681e07-49eb-4194-a7e2-ed821cd38597 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:29.977879 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82681e07-49eb-4194-a7e2-ed821cd38597 None admin] RBAC: Adding query filter params (role.id=8fdfbc4aaf68468f89a5ae3450b8488d, scope.domain.id=default, user.id=7ffe86579b7344d19702549b20bcc927) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:29.978180 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82681e07-49eb-4194-a7e2-ed821cd38597 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:29.979682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82681e07-49eb-4194-a7e2-ed821cd38597 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:29.990632 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 12/21] 10.222.0.61 () {56 vars in 1322 bytes} [Fri Aug 19 19:11:29 2022] GET /identity/v3/role_assignments?user.id=7ffe86579b7344d19702549b20bcc927&scope.domain.id=default&role.id=8fdfbc4aaf68468f89a5ae3450b8488d => generated 233 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:32.328801 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20147134-7faa-4bac-941e-7b98f68794b4 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:32.329476 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20147134-7faa-4bac-941e-7b98f68794b4 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:32.329476 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20147134-7faa-4bac-941e-7b98f68794b4 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:32.330714 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 10/22] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:32.336756 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d5d97-8d30-4eb5-9251-2a53342f7c3e None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:32.337200 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d5d97-8d30-4eb5-9251-2a53342f7c3e None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:32.337373 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d5d97-8d30-4eb5-9251-2a53342f7c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:32.363607 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-671d5d97-8d30-4eb5-9251-2a53342f7c3e None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:32.364846 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-671d5d97-8d30-4eb5-9251-2a53342f7c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:32.395102 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:32.463028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 13/23] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:11:32.584669 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e433fd4-56fe-4690-927d-b8843f38e36f None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:32.585209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e433fd4-56fe-4690-927d-b8843f38e36f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:32.585684 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e433fd4-56fe-4690-927d-b8843f38e36f None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:32.587244 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 11/24] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:32.593333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd6eb3-133d-4ce9-a248-4bac7e3bd1d9 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:32.593630 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd6eb3-133d-4ce9-a248-4bac7e3bd1d9 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:32.593909 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd6eb3-133d-4ce9-a248-4bac7e3bd1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:32.624869 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-a3fd6eb3-133d-4ce9-a248-4bac7e3bd1d9 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:32.626081 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-a3fd6eb3-133d-4ce9-a248-4bac7e3bd1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:32.722135 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23141067-9e14-410b-a0f7-41d7f5acc21c None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:32.722445 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23141067-9e14-410b-a0f7-41d7f5acc21c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:32.722716 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23141067-9e14-410b-a0f7-41d7f5acc21c None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:32.724238 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 12/25] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:11:32.729255 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3762c-ebde-47a3-9747-9edea15bb5d2 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:32.729780 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3762c-ebde-47a3-9747-9edea15bb5d2 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:32.730407 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3762c-ebde-47a3-9747-9edea15bb5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:32.738851 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 14/26] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:11:32.767888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-bec3762c-ebde-47a3-9747-9edea15bb5d2 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:32.769596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-bec3762c-ebde-47a3-9747-9edea15bb5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:32.828532 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:32.893098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 13/27] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:11:32.937038 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd6eb3-133d-4ce9-a248-4bac7e3bd1d9 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:33.058960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:33.077659 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd6eb3-133d-4ce9-a248-4bac7e3bd1d9 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:33.101905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26edd1b-a38c-4f56-a06b-bf3ae1fd9ae9 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:33.102192 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26edd1b-a38c-4f56-a06b-bf3ae1fd9ae9 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:33.102460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26edd1b-a38c-4f56-a06b-bf3ae1fd9ae9 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:33.103828 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 14/28] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:11:33.108946 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c4bb4-ac49-4be9-ae61-fcd20172087c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:33.109231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c4bb4-ac49-4be9-ae61-fcd20172087c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:33.109505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c4bb4-ac49-4be9-ae61-fcd20172087c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:33.135328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f6637-9cf1-4edf-a30d-6fe8610cfd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:33.135904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f6637-9cf1-4edf-a30d-6fe8610cfd50 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:33.136244 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f6637-9cf1-4edf-a30d-6fe8610cfd50 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:33.136519 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f6637-9cf1-4edf-a30d-6fe8610cfd50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:33.142608 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ef5c4bb4-ac49-4be9-ae61-fcd20172087c None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:33.142608 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ef5c4bb4-ac49-4be9-ae61-fcd20172087c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:33.164818 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f6637-9cf1-4edf-a30d-6fe8610cfd50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:33.166207 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f6637-9cf1-4edf-a30d-6fe8610cfd50 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:33.196871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-414f6637-9cf1-4edf-a30d-6fe8610cfd50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:11:33.196871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:11:33.196871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:11:33.196871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:11:33.196871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:11:33.196871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:11:33.196871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:11:33.196871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:11:33.196871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:11:33.196871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:11:33.196871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:11:33.196871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:11:33.196871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:11:33.196871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:11:33.196871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:11:33.196871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:11:33.197791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:11:33.197791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:11:33.197791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:11:33.197791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:11:33.197791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:11:33.197791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:11:33.197791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:11:33.197791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:11:33.197791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:11:33.197791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:11:33.197791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:11:33.197791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:11:33.197791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:11:33.197791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:11:33.197791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:11:33.197791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:11:33.197791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:11:33.198675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:11:33.198675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:11:33.198675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:11:33.198675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 15/29] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:11:33.203787 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f6637-9cf1-4edf-a30d-6fe8610cfd50 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:33.282097 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 15/30] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:11:33.283224 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c4bb4-ac49-4be9-ae61-fcd20172087c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:33.373337 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f6637-9cf1-4edf-a30d-6fe8610cfd50 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:33.439559 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077754d3-6f17-47f2-9752-47956a3fef15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:33.440091 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077754d3-6f17-47f2-9752-47956a3fef15 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:33.440376 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077754d3-6f17-47f2-9752-47956a3fef15 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:33.440907 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077754d3-6f17-47f2-9752-47956a3fef15 None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:33.441559 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077754d3-6f17-47f2-9752-47956a3fef15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:33.441864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077754d3-6f17-47f2-9752-47956a3fef15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:33.443291 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077754d3-6f17-47f2-9752-47956a3fef15 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:33.466576 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:33.469272 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:33.474428 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c4bb4-ac49-4be9-ae61-fcd20172087c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:33.482119 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 16/31] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:33.485970 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077754d3-6f17-47f2-9752-47956a3fef15 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:33.520374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00afec9-d683-49d7-bb3d-c79634d7ee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:33.521022 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00afec9-d683-49d7-bb3d-c79634d7ee23 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:33.521299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00afec9-d683-49d7-bb3d-c79634d7ee23 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:33.521575 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00afec9-d683-49d7-bb3d-c79634d7ee23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:33.547499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00afec9-d683-49d7-bb3d-c79634d7ee23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:11:33.553865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-d00afec9-d683-49d7-bb3d-c79634d7ee23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:11:33.553865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:11:33.553865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:11:33.553865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:11:33.553865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:11:33.553865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:11:33.553865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:11:33.553865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:11:33.553865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:11:33.553865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:11:33.553865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:11:33.553865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:11:33.553865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:11:33.553865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:11:33.553865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:11:33.553865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:11:33.554721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:11:33.554721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:11:33.554721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:11:33.554721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:11:33.554721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:11:33.554721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:11:33.554721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:11:33.554721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:11:33.554721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:11:33.554721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:11:33.554721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:11:33.554721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:11:33.554721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:11:33.554721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:11:33.554721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:11:33.554721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:11:33.555478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:11:33.555478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:11:33.555478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:11:33.555478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:11:33.555478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:11:33.555478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:11:33.555478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:11:33.555478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:11:33.555478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:11:33.555478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:11:33.555478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:11:33.555478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:11:33.555478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 16/32] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Aug 19 19:11:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:11:33.556673 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00afec9-d683-49d7-bb3d-c79634d7ee23 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:33.681059 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077754d3-6f17-47f2-9752-47956a3fef15 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:33.717449 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44c3ab-65cb-4a93-8f87-58d017d28d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:33.718395 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44c3ab-65cb-4a93-8f87-58d017d28d70 None admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:33.718979 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44c3ab-65cb-4a93-8f87-58d017d28d70 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:33.719463 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44c3ab-65cb-4a93-8f87-58d017d28d70 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:33.720375 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44c3ab-65cb-4a93-8f87-58d017d28d70 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:33.721961 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44c3ab-65cb-4a93-8f87-58d017d28d70 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:33.726971 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00afec9-d683-49d7-bb3d-c79634d7ee23 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:33.763577 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85879097-31a8-4dac-a9a8-475793bb3a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:33.764201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85879097-31a8-4dac-a9a8-475793bb3a59 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:33.764478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85879097-31a8-4dac-a9a8-475793bb3a59 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:33.764756 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85879097-31a8-4dac-a9a8-475793bb3a59 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:33.765394 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85879097-31a8-4dac-a9a8-475793bb3a59 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:33.767011 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85879097-31a8-4dac-a9a8-475793bb3a59 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:33.956828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 17/33] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Aug 19 19:11:33 2022] POST /identity/v3/roles => generated 219 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:11:33.958425 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44c3ab-65cb-4a93-8f87-58d017d28d70 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:33.990650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 17/34] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Aug 19 19:11:33 2022] POST /identity/v3/projects => generated 301 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:11:33.990650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85879097-31a8-4dac-a9a8-475793bb3a59 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:34.010150 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:34.148940 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:34.221826 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44c3ab-65cb-4a93-8f87-58d017d28d70 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:34.267107 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85879097-31a8-4dac-a9a8-475793bb3a59 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:34.277244 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f11c3-fcec-46f6-a944-be55b1900be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:34.277969 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f11c3-fcec-46f6-a944-be55b1900be8 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:34.278328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f11c3-fcec-46f6-a944-be55b1900be8 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:34.278717 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f11c3-fcec-46f6-a944-be55b1900be8 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:34.280170 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f11c3-fcec-46f6-a944-be55b1900be8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:34.280490 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f11c3-fcec-46f6-a944-be55b1900be8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:34.282049 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f11c3-fcec-46f6-a944-be55b1900be8 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:34.295616 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 18/35] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:11:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:34.297140 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd032d8-0537-47d9-8793-d4ffdbf72462 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:34.297543 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd032d8-0537-47d9-8793-d4ffdbf72462 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:34.297909 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd032d8-0537-47d9-8793-d4ffdbf72462 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:34.299395 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:34.304874 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd032d8-0537-47d9-8793-d4ffdbf72462 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:34.331748 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b18daa-f060-4311-937f-ef89255fb60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:34.332491 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b18daa-f060-4311-937f-ef89255fb60c None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:34.332772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b18daa-f060-4311-937f-ef89255fb60c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:34.333045 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b18daa-f060-4311-937f-ef89255fb60c None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:34.333722 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b18daa-f060-4311-937f-ef89255fb60c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:34.335325 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b18daa-f060-4311-937f-ef89255fb60c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:34.408427 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Aug 19 19:11:33 2022] POST /identity/v3/roles => generated 225 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:11:34.409930 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1f5a4-1cb0-477e-a12a-9829a0ec46bd None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:34.410301 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1f5a4-1cb0-477e-a12a-9829a0ec46bd None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:34.410724 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1f5a4-1cb0-477e-a12a-9829a0ec46bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:34.433122 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-afe1f5a4-1cb0-477e-a12a-9829a0ec46bd None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:34.435408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-afe1f5a4-1cb0-477e-a12a-9829a0ec46bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:34.447297 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd032d8-0537-47d9-8793-d4ffdbf72462 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:34.478305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:34.494357 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b692285-188e-4878-a1e4-81bc9764c2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:34.495160 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b692285-188e-4878-a1e4-81bc9764c2c8 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:34.495578 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b692285-188e-4878-a1e4-81bc9764c2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:34.495953 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b692285-188e-4878-a1e4-81bc9764c2c8 None admin] PATH_INFO: `/v3/users/7ffe86579b7344d19702549b20bcc927` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:34.497309 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b692285-188e-4878-a1e4-81bc9764c2c8 None admin] RBAC: Authorizing `identity:get_user(user_id=7ffe86579b7344d19702549b20bcc927)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:34.499723 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b692285-188e-4878-a1e4-81bc9764c2c8 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:34.506201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:11:34 2022] GET /identity/v3/users/7ffe86579b7344d19702549b20bcc927 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:34.506201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f4047-c7e1-4fc3-9417-d5ac3969a34b None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:34.506201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f4047-c7e1-4fc3-9417-d5ac3969a34b None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:34.506201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f4047-c7e1-4fc3-9417-d5ac3969a34b None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:34.506201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 21/39] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:34.510326 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f4047-c7e1-4fc3-9417-d5ac3969a34b None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:34.520495 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:34.531030 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 19/40] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:11:34.538966 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9d590-e737-406a-9566-475fde2316f7 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:34.539259 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9d590-e737-406a-9566-475fde2316f7 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:34.539531 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9d590-e737-406a-9566-475fde2316f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:34.580171 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-d7f9d590-e737-406a-9566-475fde2316f7 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:34.581948 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d7f9d590-e737-406a-9566-475fde2316f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:34.660715 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f4047-c7e1-4fc3-9417-d5ac3969a34b None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:34.687187 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 20/41] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:11:34.700283 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca35d57-183c-431c-a048-2c68f4185055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:34.700921 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca35d57-183c-431c-a048-2c68f4185055 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:34.701263 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca35d57-183c-431c-a048-2c68f4185055 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:34.701545 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca35d57-183c-431c-a048-2c68f4185055 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:34.702777 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca35d57-183c-431c-a048-2c68f4185055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:34.704209 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca35d57-183c-431c-a048-2c68f4185055 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:34.706236 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 22/42] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:11:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:34.711795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9d590-e737-406a-9566-475fde2316f7 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:34.815080 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9d590-e737-406a-9566-475fde2316f7 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:34.842776 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:34.851579 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c74951-69c8-419c-b965-07e3b8948ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:34.852247 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c74951-69c8-419c-b965-07e3b8948ac0 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:34.852529 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c74951-69c8-419c-b965-07e3b8948ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:34.852813 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c74951-69c8-419c-b965-07e3b8948ac0 None admin] PATH_INFO: `/v3/domains/default/users/7ffe86579b7344d19702549b20bcc927/roles/8fdfbc4aaf68468f89a5ae3450b8488d` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:34.856163 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c74951-69c8-419c-b965-07e3b8948ac0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7ffe86579b7344d19702549b20bcc927, role_id=8fdfbc4aaf68468f89a5ae3450b8488d)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:34.857009 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c74951-69c8-419c-b965-07e3b8948ac0 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:34.872177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca35d57-183c-431c-a048-2c68f4185055 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:34.929223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:34.952092 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 21/43] 10.222.0.61 () {58 vars in 1361 bytes} [Fri Aug 19 19:11:34 2022] PUT /identity/v3/domains/default/users/7ffe86579b7344d19702549b20bcc927/roles/8fdfbc4aaf68468f89a5ae3450b8488d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 19:11:34.977956 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca35d57-183c-431c-a048-2c68f4185055 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:35.017858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c3b7e-24c3-4ba9-b180-7166cd0076c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:35.018498 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3b7e-24c3-4ba9-b180-7166cd0076c0 None admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:35.018908 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3b7e-24c3-4ba9-b180-7166cd0076c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:35.019197 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3b7e-24c3-4ba9-b180-7166cd0076c0 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:35.019889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c3b7e-24c3-4ba9-b180-7166cd0076c0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:35.020209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c74951-69c8-419c-b965-07e3b8948ac0 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:35.021317 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c3b7e-24c3-4ba9-b180-7166cd0076c0 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:35.118790 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Aug 19 19:11:34 2022] POST /identity/v3/roles => generated 223 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:11:35.143329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c74951-69c8-419c-b965-07e3b8948ac0 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:35.184900 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9611b-0d30-4dc2-b1eb-18bdb9c962f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:35.185571 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9611b-0d30-4dc2-b1eb-18bdb9c962f9 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:35.185852 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9611b-0d30-4dc2-b1eb-18bdb9c962f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:35.186126 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9611b-0d30-4dc2-b1eb-18bdb9c962f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:35.187376 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9611b-0d30-4dc2-b1eb-18bdb9c962f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:35.188891 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9611b-0d30-4dc2-b1eb-18bdb9c962f9 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:35.191080 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 22/45] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:11:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:35.196505 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c3b7e-24c3-4ba9-b180-7166cd0076c0 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:35.309027 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c3b7e-24c3-4ba9-b180-7166cd0076c0 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:35.327599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:35.346706 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1319d9e-75c5-482b-8287-e193d56cd7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:35.347333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1319d9e-75c5-482b-8287-e193d56cd7b0 None admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:35.347618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1319d9e-75c5-482b-8287-e193d56cd7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:35.347892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1319d9e-75c5-482b-8287-e193d56cd7b0 None admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:35.348548 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1319d9e-75c5-482b-8287-e193d56cd7b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:35.350074 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1319d9e-75c5-482b-8287-e193d56cd7b0 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:35.428624 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Aug 19 19:11:35 2022] POST /identity/v3/projects => generated 312 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:11:37.140226 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195e12b-0888-4f55-8bf2-77546fb39876 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:37.140760 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195e12b-0888-4f55-8bf2-77546fb39876 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:37.140760 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195e12b-0888-4f55-8bf2-77546fb39876 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:37.142127 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 23/47] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:37.147336 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60006e-a4af-41b4-92ab-bee06ac8d816 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:37.147721 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60006e-a4af-41b4-92ab-bee06ac8d816 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:37.147908 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60006e-a4af-41b4-92ab-bee06ac8d816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:37.166022 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-aa60006e-a4af-41b4-92ab-bee06ac8d816 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:37.167615 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-aa60006e-a4af-41b4-92ab-bee06ac8d816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:37.235589 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 25/48] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:11:37.561157 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195e12b-0888-4f55-8bf2-77546fb39876 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:37.618919 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:37.654815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24185b-ee4a-4f62-8450-d1c049b231e0 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:37.655098 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24185b-ee4a-4f62-8450-d1c049b231e0 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:37.655385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24185b-ee4a-4f62-8450-d1c049b231e0 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:37.656723 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 26/49] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:11:37.661679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670b96a-caa3-45f4-8799-e7426fcd0247 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:37.661967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670b96a-caa3-45f4-8799-e7426fcd0247 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:37.662246 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670b96a-caa3-45f4-8799-e7426fcd0247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:37.668484 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195e12b-0888-4f55-8bf2-77546fb39876 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:37.680498 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-2670b96a-caa3-45f4-8799-e7426fcd0247 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:37.681707 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-2670b96a-caa3-45f4-8799-e7426fcd0247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:37.704350 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0f718-d024-4e36-9f61-1a95845373e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:37.704986 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0f718-d024-4e36-9f61-1a95845373e1 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:37.705266 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0f718-d024-4e36-9f61-1a95845373e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:37.705546 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0f718-d024-4e36-9f61-1a95845373e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:37.716378 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0f718-d024-4e36-9f61-1a95845373e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:11:37.721560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-bcc0f718-d024-4e36-9f61-1a95845373e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:11:37.721560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:11:37.721560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:11:37.721560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:11:37.721560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:11:37.721560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:11:37.721560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:11:37.721560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:11:37.721560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:11:37.721560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:11:37.721560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:11:37.721560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:11:37.721560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:11:37.721560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:11:37.721560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:11:37.721560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:11:37.722364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:11:37.722364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:11:37.722364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:11:37.722364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:11:37.722364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:11:37.722364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:11:37.722364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:11:37.722364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:11:37.722364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:11:37.722364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:11:37.722364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:11:37.722364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:11:37.722364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:11:37.722364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:11:37.722364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:11:37.722364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:11:37.723324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:11:37.723324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:11:37.723324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:11:37.723324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:11:37.723324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:11:37.723324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:11:37.723324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:11:37.723324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:11:37.723324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:11:37.723324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:11:37.723324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:11:37.723324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:11:37.723324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 24/50] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Aug 19 19:11:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:11:37.728392 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0f718-d024-4e36-9f61-1a95845373e1 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:37.750187 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 27/51] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:11:37.827565 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0f718-d024-4e36-9f61-1a95845373e1 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:37.840746 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:37.859912 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711dcc8-b2bd-4c53-9d8f-6d3847fe5266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:37.860520 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711dcc8-b2bd-4c53-9d8f-6d3847fe5266 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:37.860799 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711dcc8-b2bd-4c53-9d8f-6d3847fe5266 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:37.861072 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711dcc8-b2bd-4c53-9d8f-6d3847fe5266 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:37.861735 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711dcc8-b2bd-4c53-9d8f-6d3847fe5266 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:37.862038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711dcc8-b2bd-4c53-9d8f-6d3847fe5266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:37.863460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711dcc8-b2bd-4c53-9d8f-6d3847fe5266 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:37.876088 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 25/52] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:11:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:37.881725 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670b96a-caa3-45f4-8799-e7426fcd0247 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:37.909943 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:37.991041 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670b96a-caa3-45f4-8799-e7426fcd0247 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:38.025625 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8ab86-05bd-41af-8bfc-9bcdd803fcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:38.026262 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8ab86-05bd-41af-8bfc-9bcdd803fcf7 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:38.026623 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8ab86-05bd-41af-8bfc-9bcdd803fcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:38.026899 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8ab86-05bd-41af-8bfc-9bcdd803fcf7 None admin] PATH_INFO: `/v3/users/7ffe86579b7344d19702549b20bcc927` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:38.028027 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8ab86-05bd-41af-8bfc-9bcdd803fcf7 None admin] RBAC: Authorizing `identity:get_user(user_id=7ffe86579b7344d19702549b20bcc927)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:38.029468 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8ab86-05bd-41af-8bfc-9bcdd803fcf7 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:38.031088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 28/53] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:11:37 2022] GET /identity/v3/users/7ffe86579b7344d19702549b20bcc927 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:38.036606 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711dcc8-b2bd-4c53-9d8f-6d3847fe5266 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:38.097791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8ab86-05bd-41af-8bfc-9bcdd803fcf7 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:38.143900 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711dcc8-b2bd-4c53-9d8f-6d3847fe5266 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:38.177763 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbb499-55a3-4c5d-8f34-555441d4dc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:38.178398 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbb499-55a3-4c5d-8f34-555441d4dc32 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:38.178718 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbb499-55a3-4c5d-8f34-555441d4dc32 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:38.178999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbb499-55a3-4c5d-8f34-555441d4dc32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:38.180123 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbb499-55a3-4c5d-8f34-555441d4dc32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:38.181591 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbb499-55a3-4c5d-8f34-555441d4dc32 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:38.183814 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 26/54] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:11:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:38.189601 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbb499-55a3-4c5d-8f34-555441d4dc32 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:38.201043 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:38.207413 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8ab86-05bd-41af-8bfc-9bcdd803fcf7 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:38.236607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:38.242067 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38f7e4-4e08-4636-9c41-21221c957b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:38.242721 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38f7e4-4e08-4636-9c41-21221c957b22 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:38.243003 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38f7e4-4e08-4636-9c41-21221c957b22 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:38.243278 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38f7e4-4e08-4636-9c41-21221c957b22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:38.244439 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38f7e4-4e08-4636-9c41-21221c957b22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:38.246530 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38f7e4-4e08-4636-9c41-21221c957b22 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:38.248115 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 29/55] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:11:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:38.253745 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38f7e4-4e08-4636-9c41-21221c957b22 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:38.290152 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbb499-55a3-4c5d-8f34-555441d4dc32 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:38.325775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e932aba-99a5-4763-97f5-f67c592a8ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:38.326380 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e932aba-99a5-4763-97f5-f67c592a8ed6 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:38.326693 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e932aba-99a5-4763-97f5-f67c592a8ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:38.326972 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e932aba-99a5-4763-97f5-f67c592a8ed6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:38.327685 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e932aba-99a5-4763-97f5-f67c592a8ed6 None admin] RBAC: Adding query filter params (role.id=8fdfbc4aaf68468f89a5ae3450b8488d, scope.domain.id=default, user.id=7ffe86579b7344d19702549b20bcc927) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:38.328002 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e932aba-99a5-4763-97f5-f67c592a8ed6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:38.329459 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e932aba-99a5-4763-97f5-f67c592a8ed6 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:38.337148 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 27/56] 10.222.0.61 () {56 vars in 1322 bytes} [Fri Aug 19 19:11:38 2022] GET /identity/v3/role_assignments?user.id=7ffe86579b7344d19702549b20bcc927&scope.domain.id=default&role.id=8fdfbc4aaf68468f89a5ae3450b8488d => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:38.354459 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38f7e4-4e08-4636-9c41-21221c957b22 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:38.393105 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bc026-184e-41b4-9f5f-214d7d6b5350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:38.393726 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bc026-184e-41b4-9f5f-214d7d6b5350 None admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:38.394009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bc026-184e-41b4-9f5f-214d7d6b5350 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:38.394281 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bc026-184e-41b4-9f5f-214d7d6b5350 None admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:38.394965 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bc026-184e-41b4-9f5f-214d7d6b5350 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:38.396475 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bc026-184e-41b4-9f5f-214d7d6b5350 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:38.483554 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 30/57] 10.222.0.61 () {60 vars in 1140 bytes} [Fri Aug 19 19:11:38 2022] POST /identity/v3/projects => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:11:40.723921 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335f1f2-9b96-4fce-ba7c-efdc8406dbdb None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:40.724423 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335f1f2-9b96-4fce-ba7c-efdc8406dbdb None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:40.724507 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335f1f2-9b96-4fce-ba7c-efdc8406dbdb None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:40.725804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 28/58] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:40.731009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f170aa9-14f6-48b3-8664-1905b49701ae None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:40.731381 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f170aa9-14f6-48b3-8664-1905b49701ae None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:40.731566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f170aa9-14f6-48b3-8664-1905b49701ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:40.749787 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-0f170aa9-14f6-48b3-8664-1905b49701ae None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:40.751010 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-0f170aa9-14f6-48b3-8664-1905b49701ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:40.762163 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:40.818420 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 31/59] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:11:41.151641 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335f1f2-9b96-4fce-ba7c-efdc8406dbdb None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:41.252400 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335f1f2-9b96-4fce-ba7c-efdc8406dbdb None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:41.261074 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:41.284803 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf80af-0554-4a4a-9f1d-42e479f42f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:41.285434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf80af-0554-4a4a-9f1d-42e479f42f82 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:41.285717 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf80af-0554-4a4a-9f1d-42e479f42f82 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:41.286043 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf80af-0554-4a4a-9f1d-42e479f42f82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:41.287177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf80af-0554-4a4a-9f1d-42e479f42f82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:41.288792 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf80af-0554-4a4a-9f1d-42e479f42f82 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:41.290198 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 29/60] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:11:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:41.296602 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f170aa9-14f6-48b3-8664-1905b49701ae None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:41.400664 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f170aa9-14f6-48b3-8664-1905b49701ae None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:41.436505 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21409e55-0741-42b4-9de5-d774adc047a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:41.437045 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21409e55-0741-42b4-9de5-d774adc047a0 None admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:41.437326 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21409e55-0741-42b4-9de5-d774adc047a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:41.437599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21409e55-0741-42b4-9de5-d774adc047a0 None admin] PATH_INFO: `/v3/users` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:41.438248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21409e55-0741-42b4-9de5-d774adc047a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:41.439735 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21409e55-0741-42b4-9de5-d774adc047a0 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:41.544568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 32/61] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Aug 19 19:11:41 2022] POST /identity/v3/users => generated 275 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:11:44.946672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b44cc-5082-4859-a032-5cecf7c8cd46 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:44.947144 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b44cc-5082-4859-a032-5cecf7c8cd46 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:44.947144 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b44cc-5082-4859-a032-5cecf7c8cd46 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:44.948691 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 30/62] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:44.956211 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203498d-f375-4915-8f8d-32ef2f142609 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:44.956659 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203498d-f375-4915-8f8d-32ef2f142609 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:44.956839 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203498d-f375-4915-8f8d-32ef2f142609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:44.965081 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:44.982972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-7203498d-f375-4915-8f8d-32ef2f142609 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:44.993367 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-7203498d-f375-4915-8f8d-32ef2f142609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:45.079883 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 33/63] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:11:45.215494 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63245e6f-3c85-4ee3-aba1-e20df53906bf None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:45.215977 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63245e6f-3c85-4ee3-aba1-e20df53906bf None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:45.216389 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63245e6f-3c85-4ee3-aba1-e20df53906bf None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:45.217881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 31/64] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:45.223325 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7f39f-0180-4076-a57c-d95c7a63b45c None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:45.223771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7f39f-0180-4076-a57c-d95c7a63b45c None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:45.224181 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7f39f-0180-4076-a57c-d95c7a63b45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:45.247535 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-cfb7f39f-0180-4076-a57c-d95c7a63b45c None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:45.248975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-cfb7f39f-0180-4076-a57c-d95c7a63b45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:45.339896 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 34/65] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:11:45.431194 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c291d6-9afc-4f14-8674-520bfa195403 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:45.431702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c291d6-9afc-4f14-8674-520bfa195403 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:45.432110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c291d6-9afc-4f14-8674-520bfa195403 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:45.434682 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 32/66] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:45.440876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8c614-3549-4e12-9706-b89f9b7c7b9c None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:45.441330 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8c614-3549-4e12-9706-b89f9b7c7b9c None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:45.441742 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8c614-3549-4e12-9706-b89f9b7c7b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:45.473015 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-ecd8c614-3549-4e12-9706-b89f9b7c7b9c None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:45.474420 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-ecd8c614-3549-4e12-9706-b89f9b7c7b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:45.480655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9d995-8169-48a5-82f1-ec02846cabf4 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:45.480944 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9d995-8169-48a5-82f1-ec02846cabf4 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:45.481223 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9d995-8169-48a5-82f1-ec02846cabf4 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:45.482600 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 33/67] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:45.487712 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a27ff-b374-40cd-ae96-fc733f9dce7c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:45.488278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a27ff-b374-40cd-ae96-fc733f9dce7c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:45.488750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a27ff-b374-40cd-ae96-fc733f9dce7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:45.507836 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-4b3a27ff-b374-40cd-ae96-fc733f9dce7c None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:45.509348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4b3a27ff-b374-40cd-ae96-fc733f9dce7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:45.580776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:45.583110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 34/68] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:11:45.585466 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a27ff-b374-40cd-ae96-fc733f9dce7c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:45.588873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 35/69] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:11:45.623210 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd9587-4e14-4b74-8a75-8e533bb4dbbf None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:45.623821 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd9587-4e14-4b74-8a75-8e533bb4dbbf None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:45.624316 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd9587-4e14-4b74-8a75-8e533bb4dbbf None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:45.625917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 36/70] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:11:45.631038 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef59b5-7c10-4a42-b950-dd5521be821d None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:45.631544 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef59b5-7c10-4a42-b950-dd5521be821d None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:45.632034 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef59b5-7c10-4a42-b950-dd5521be821d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:45.650218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-4bef59b5-7c10-4a42-b950-dd5521be821d None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:45.651824 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-4bef59b5-7c10-4a42-b950-dd5521be821d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:45.703990 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a27ff-b374-40cd-ae96-fc733f9dce7c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:45.719206 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:45.732304 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 37/71] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:11:45.783793 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0848109-8683-4d23-a848-a9eec8864a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:45.784437 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0848109-8683-4d23-a848-a9eec8864a99 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:45.784721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0848109-8683-4d23-a848-a9eec8864a99 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:45.784994 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0848109-8683-4d23-a848-a9eec8864a99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:45.793442 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef59b5-7c10-4a42-b950-dd5521be821d None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:45.803490 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0848109-8683-4d23-a848-a9eec8864a99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:11:45.809678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-f0848109-8683-4d23-a848-a9eec8864a99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:11:45.809678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:11:45.809678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:11:45.809678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:11:45.809678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:11:45.809678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:11:45.809678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:11:45.809678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:11:45.809678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:11:45.809678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:11:45.809678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:11:45.809678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:11:45.809678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:11:45.809678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:11:45.809678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:11:45.809678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:11:45.810559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:11:45.810559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:11:45.810559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:11:45.810559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:11:45.810559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:11:45.810559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:11:45.810559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:11:45.810559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:11:45.810559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:11:45.810559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:11:45.810559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:11:45.810559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:11:45.810559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:11:45.810559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:11:45.810559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:11:45.810559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:11:45.811311 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:11:45.811311 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:11:45.811311 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:11:45.811311 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:11:45.811311 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:11:45.811311 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:11:45.811311 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:11:45.811311 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:11:45.811311 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:11:45.811311 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:11:45.811311 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:11:45.811311 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:11:45.811311 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 35/72] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:11:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:11:45.819542 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0848109-8683-4d23-a848-a9eec8864a99 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:45.932056 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0848109-8683-4d23-a848-a9eec8864a99 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:45.961080 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef59b5-7c10-4a42-b950-dd5521be821d None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:45.970605 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef5a67-17cc-4569-ba0a-a36fd825f09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:45.971900 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef5a67-17cc-4569-ba0a-a36fd825f09e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:45.972376 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef5a67-17cc-4569-ba0a-a36fd825f09e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:45.972960 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef5a67-17cc-4569-ba0a-a36fd825f09e None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:45.973824 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef5a67-17cc-4569-ba0a-a36fd825f09e None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:45.974337 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef5a67-17cc-4569-ba0a-a36fd825f09e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:45.976028 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef5a67-17cc-4569-ba0a-a36fd825f09e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:45.986201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:45.986610 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 36/73] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:11:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:45.988440 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef5a67-17cc-4569-ba0a-a36fd825f09e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:46.003379 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd282255-4978-4b6f-a63d-c40137862e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:46.004028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd282255-4978-4b6f-a63d-c40137862e20 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:46.004307 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd282255-4978-4b6f-a63d-c40137862e20 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:46.004576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd282255-4978-4b6f-a63d-c40137862e20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:46.015348 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd282255-4978-4b6f-a63d-c40137862e20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:11:46.021536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-dd282255-4978-4b6f-a63d-c40137862e20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:11:46.021536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:11:46.021536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:11:46.021536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:11:46.021536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:11:46.021536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:11:46.021536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:11:46.021536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:11:46.021536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:11:46.021536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:11:46.021536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:11:46.021536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:11:46.021536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:11:46.021536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:11:46.021536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:11:46.021536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:11:46.022378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:11:46.022378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:11:46.022378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:11:46.022378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:11:46.022378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:11:46.022378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:11:46.022378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:11:46.022378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:11:46.022378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:11:46.022378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:11:46.022378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:11:46.022378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:11:46.022378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:11:46.022378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:11:46.022378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:11:46.022378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:11:46.023158 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:11:46.023158 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:11:46.023158 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:11:46.023158 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:11:46.023158 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:11:46.023158 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:11:46.023158 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:11:46.023158 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:11:46.023158 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:11:46.023158 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:11:46.023158 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:11:46.023158 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:11:46.023158 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 38/74] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:11:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:11:46.023883 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd282255-4978-4b6f-a63d-c40137862e20 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:46.030949 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:46.103386 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef5a67-17cc-4569-ba0a-a36fd825f09e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:46.127574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd282255-4978-4b6f-a63d-c40137862e20 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:46.138497 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043eb9b-36e5-4934-8f3a-c45a6fba09fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:46.139161 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043eb9b-36e5-4934-8f3a-c45a6fba09fe None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:46.139440 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043eb9b-36e5-4934-8f3a-c45a6fba09fe None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:46.139711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043eb9b-36e5-4934-8f3a-c45a6fba09fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:46.150034 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043eb9b-36e5-4934-8f3a-c45a6fba09fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:11:46.155672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-8043eb9b-36e5-4934-8f3a-c45a6fba09fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:11:46.155672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:11:46.155672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:11:46.155672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:11:46.155672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:11:46.155672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:11:46.155672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:11:46.155672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:11:46.155672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:11:46.155672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:11:46.155672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:11:46.155672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:11:46.155672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:11:46.155672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:11:46.155672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:11:46.155672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:11:46.156505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:11:46.156505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:11:46.156505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:11:46.156505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:11:46.156505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:11:46.156505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:11:46.156505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:11:46.156505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:11:46.156505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:11:46.156505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:11:46.156505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:11:46.156505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:11:46.156505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:11:46.156505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:11:46.156505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:11:46.156505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:11:46.157239 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:11:46.157239 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:11:46.157239 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:11:46.157239 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:11:46.157239 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:11:46.157239 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:11:46.157239 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:11:46.157239 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:11:46.157239 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:11:46.157239 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:11:46.157239 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:11:46.157239 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:11:46.157239 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 37/75] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Aug 19 19:11:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:11:46.158060 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043eb9b-36e5-4934-8f3a-c45a6fba09fe None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:46.164654 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2c85a-a390-4d1d-9dc4-bf3c98f77ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:46.165292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2c85a-a390-4d1d-9dc4-bf3c98f77ecc None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:46.165575 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2c85a-a390-4d1d-9dc4-bf3c98f77ecc None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:46.166262 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2c85a-a390-4d1d-9dc4-bf3c98f77ecc None admin] PATH_INFO: `/v3/users/9d563cd2f3b848a3b1b5f14c04761740` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:46.182022 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2c85a-a390-4d1d-9dc4-bf3c98f77ecc None admin] RBAC: Authorizing `identity:get_user(user_id=9d563cd2f3b848a3b1b5f14c04761740)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:46.183605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2c85a-a390-4d1d-9dc4-bf3c98f77ecc None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:46.185232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 39/76] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:11:46 2022] GET /identity/v3/users/9d563cd2f3b848a3b1b5f14c04761740 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:46.185998 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2c85a-a390-4d1d-9dc4-bf3c98f77ecc None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:46.226953 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:46.252113 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:46.265394 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043eb9b-36e5-4934-8f3a-c45a6fba09fe None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:46.286883 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2c85a-a390-4d1d-9dc4-bf3c98f77ecc None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:46.298777 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c8673-b374-4a37-a9eb-dbef56044095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:46.299377 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c8673-b374-4a37-a9eb-dbef56044095 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:46.299657 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c8673-b374-4a37-a9eb-dbef56044095 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:46.299930 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c8673-b374-4a37-a9eb-dbef56044095 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:46.300588 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c8673-b374-4a37-a9eb-dbef56044095 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:46.300889 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c8673-b374-4a37-a9eb-dbef56044095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:46.302260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c8673-b374-4a37-a9eb-dbef56044095 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:46.310130 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 38/77] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:11:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:46.310940 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c8673-b374-4a37-a9eb-dbef56044095 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:46.328475 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c8545-7873-474d-bf51-b4b8486a34fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:46.329115 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c8545-7873-474d-bf51-b4b8486a34fb None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:46.329393 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c8545-7873-474d-bf51-b4b8486a34fb None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:46.329664 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c8545-7873-474d-bf51-b4b8486a34fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:46.340293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c8545-7873-474d-bf51-b4b8486a34fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:11:46.345083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-a51c8545-7873-474d-bf51-b4b8486a34fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:11:46.345083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:11:46.345083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:11:46.345083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:11:46.345083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:11:46.345083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:11:46.345083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:11:46.345083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:11:46.345083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:11:46.345083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:11:46.345083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:11:46.345083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:11:46.345083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:11:46.345083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:11:46.345083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:11:46.345083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:11:46.345919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:11:46.345919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:11:46.345919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:11:46.345919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:11:46.345919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:11:46.345919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:11:46.345919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:11:46.345919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:11:46.345919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:11:46.345919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:11:46.345919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:11:46.345919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:11:46.345919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:11:46.345919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:11:46.345919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:11:46.345919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:11:46.346686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:11:46.346686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:11:46.346686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:11:46.346686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:11:46.346686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:11:46.346686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:11:46.346686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:11:46.346686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:11:46.346686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:11:46.346686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:11:46.346686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:11:46.346686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:11:46.346686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 40/78] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:11:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:11:46.347309 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c8545-7873-474d-bf51-b4b8486a34fb None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:46.411039 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c8673-b374-4a37-a9eb-dbef56044095 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:46.443432 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:46.445151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adf379-654b-45a8-8b6c-69cd3285ff17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:46.445776 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adf379-654b-45a8-8b6c-69cd3285ff17 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:46.446053 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adf379-654b-45a8-8b6c-69cd3285ff17 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:46.446325 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adf379-654b-45a8-8b6c-69cd3285ff17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:46.446412 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c8545-7873-474d-bf51-b4b8486a34fb None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:46.447470 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07adf379-654b-45a8-8b6c-69cd3285ff17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:46.448949 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07adf379-654b-45a8-8b6c-69cd3285ff17 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:46.450500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 39/79] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:11:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:46.451285 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adf379-654b-45a8-8b6c-69cd3285ff17 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:46.471061 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:46.481823 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b0d1e-674e-41dd-ac95-4d68da0d53fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:46.482514 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b0d1e-674e-41dd-ac95-4d68da0d53fc None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:46.482999 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b0d1e-674e-41dd-ac95-4d68da0d53fc None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:46.483289 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b0d1e-674e-41dd-ac95-4d68da0d53fc None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:46.484012 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b0d1e-674e-41dd-ac95-4d68da0d53fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:46.484516 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b0d1e-674e-41dd-ac95-4d68da0d53fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:46.486285 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b0d1e-674e-41dd-ac95-4d68da0d53fc None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:46.494157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 41/80] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:11:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:46.497754 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b0d1e-674e-41dd-ac95-4d68da0d53fc None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:46.553497 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adf379-654b-45a8-8b6c-69cd3285ff17 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:46.591372 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7abf1b-269d-439a-82b2-67478700e483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:46.591980 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7abf1b-269d-439a-82b2-67478700e483 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:46.592261 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7abf1b-269d-439a-82b2-67478700e483 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:46.592531 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7abf1b-269d-439a-82b2-67478700e483 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:46.598351 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b0d1e-674e-41dd-ac95-4d68da0d53fc None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:46.632269 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb27faf-8ea1-4ed5-ad00-88906b2dd63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:46.632894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb27faf-8ea1-4ed5-ad00-88906b2dd63d None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:46.633173 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb27faf-8ea1-4ed5-ad00-88906b2dd63d None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:46.633442 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb27faf-8ea1-4ed5-ad00-88906b2dd63d None admin] PATH_INFO: `/v3/users/9d563cd2f3b848a3b1b5f14c04761740` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:46.634583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb27faf-8ea1-4ed5-ad00-88906b2dd63d None admin] RBAC: Authorizing `identity:get_user(user_id=9d563cd2f3b848a3b1b5f14c04761740)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:46.636062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb27faf-8ea1-4ed5-ad00-88906b2dd63d None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:46.637625 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 42/81] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:11:46 2022] GET /identity/v3/users/9d563cd2f3b848a3b1b5f14c04761740 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:46.639423 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb27faf-8ea1-4ed5-ad00-88906b2dd63d None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:46.659270 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7abf1b-269d-439a-82b2-67478700e483 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:46.660743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7abf1b-269d-439a-82b2-67478700e483 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:46.673121 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:46.678685 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:46.742399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb27faf-8ea1-4ed5-ad00-88906b2dd63d None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:46.759592 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 40/82] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:11:46.760411 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7abf1b-269d-439a-82b2-67478700e483 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:46.779352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a38c92-b1c1-4ebc-b810-4426940ad19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:46.779959 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a38c92-b1c1-4ebc-b810-4426940ad19d None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:46.780242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a38c92-b1c1-4ebc-b810-4426940ad19d None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:46.780514 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a38c92-b1c1-4ebc-b810-4426940ad19d None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:46.781172 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a38c92-b1c1-4ebc-b810-4426940ad19d None admin] RBAC: Adding query filter params (name=member) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:46.781481 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a38c92-b1c1-4ebc-b810-4426940ad19d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:46.782884 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a38c92-b1c1-4ebc-b810-4426940ad19d None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:46.791143 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 43/83] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:11:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:46.792536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a38c92-b1c1-4ebc-b810-4426940ad19d None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:46.859376 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7abf1b-269d-439a-82b2-67478700e483 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:46.877367 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:46.885041 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:46.894042 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a38c92-b1c1-4ebc-b810-4426940ad19d None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:46.894425 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda7e96-63f0-4f73-8a97-39bada50e363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:46.895114 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda7e96-63f0-4f73-8a97-39bada50e363 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:46.895428 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda7e96-63f0-4f73-8a97-39bada50e363 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:46.895697 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda7e96-63f0-4f73-8a97-39bada50e363 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:46.896330 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda7e96-63f0-4f73-8a97-39bada50e363 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:46.897790 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda7e96-63f0-4f73-8a97-39bada50e363 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:46.926465 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55187214-1389-43d8-a2db-692443f77722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:46.927135 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55187214-1389-43d8-a2db-692443f77722 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:46.927419 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55187214-1389-43d8-a2db-692443f77722 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:46.927695 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55187214-1389-43d8-a2db-692443f77722 None admin] PATH_INFO: `/v3/users/7ffe86579b7344d19702549b20bcc927` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:46.928816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55187214-1389-43d8-a2db-692443f77722 None admin] RBAC: Authorizing `identity:get_user(user_id=7ffe86579b7344d19702549b20bcc927)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:46.930256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55187214-1389-43d8-a2db-692443f77722 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:46.931857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 44/84] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:11:46 2022] GET /identity/v3/users/7ffe86579b7344d19702549b20bcc927 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:46.933388 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55187214-1389-43d8-a2db-692443f77722 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:46.996760 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 41/85] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Aug 19 19:11:46 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:11:46.997659 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda7e96-63f0-4f73-8a97-39bada50e363 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:47.048539 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55187214-1389-43d8-a2db-692443f77722 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:47.086842 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6b171-b775-46d2-a458-c29c18cb3f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:47.087449 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6b171-b775-46d2-a458-c29c18cb3f4e None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:47.087732 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6b171-b775-46d2-a458-c29c18cb3f4e None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:47.088001 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6b171-b775-46d2-a458-c29c18cb3f4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:47.113111 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda7e96-63f0-4f73-8a97-39bada50e363 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:47.118437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:47.154197 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8e3a6-7d6a-4440-a6b1-7454d10d1bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:47.154977 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8e3a6-7d6a-4440-a6b1-7454d10d1bb8 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:47.155334 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8e3a6-7d6a-4440-a6b1-7454d10d1bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:47.155671 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8e3a6-7d6a-4440-a6b1-7454d10d1bb8 None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:47.157001 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8e3a6-7d6a-4440-a6b1-7454d10d1bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=91bbd1bb0efc40338fac7e525cc596d1)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:47.158608 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8e3a6-7d6a-4440-a6b1-7454d10d1bb8 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:47.160299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 42/86] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:11:46 2022] GET /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:47.161094 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8e3a6-7d6a-4440-a6b1-7454d10d1bb8 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:47.164357 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6b171-b775-46d2-a458-c29c18cb3f4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:47.166018 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6b171-b775-46d2-a458-c29c18cb3f4e None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:47.215960 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:47.278686 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8e3a6-7d6a-4440-a6b1-7454d10d1bb8 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:47.296244 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 45/87] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:11:47.297166 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6b171-b775-46d2-a458-c29c18cb3f4e None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:47.325895 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc8a19-d49d-409f-90d9-4eb3b7e0a668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:47.326565 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc8a19-d49d-409f-90d9-4eb3b7e0a668 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:47.326864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc8a19-d49d-409f-90d9-4eb3b7e0a668 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:47.327138 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc8a19-d49d-409f-90d9-4eb3b7e0a668 None admin] PATH_INFO: `/v3/users/9d563cd2f3b848a3b1b5f14c04761740` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:47.328306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc8a19-d49d-409f-90d9-4eb3b7e0a668 None admin] RBAC: Authorizing `identity:get_user(user_id=9d563cd2f3b848a3b1b5f14c04761740)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:47.329749 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc8a19-d49d-409f-90d9-4eb3b7e0a668 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:47.331663 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 43/88] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:11:47 2022] GET /identity/v3/users/9d563cd2f3b848a3b1b5f14c04761740 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:47.332459 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc8a19-d49d-409f-90d9-4eb3b7e0a668 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:47.404100 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:47.456116 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc8a19-d49d-409f-90d9-4eb3b7e0a668 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:47.470537 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:47.471680 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6b171-b775-46d2-a458-c29c18cb3f4e None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:47.509851 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49504223-ae59-4702-9f49-1328f3d56792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:47.510484 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49504223-ae59-4702-9f49-1328f3d56792 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:47.511064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49504223-ae59-4702-9f49-1328f3d56792 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:47.511338 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49504223-ae59-4702-9f49-1328f3d56792 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:47.512077 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49504223-ae59-4702-9f49-1328f3d56792 None admin] RBAC: Adding query filter params (role.id=83a904d35afc48fe9f8d55c0fd1597d8, scope.project.id=91bbd1bb0efc40338fac7e525cc596d1, user.id=9d563cd2f3b848a3b1b5f14c04761740) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:47.512333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a64ef-3190-45b9-8162-938b306e046a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:47.512443 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49504223-ae59-4702-9f49-1328f3d56792 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:47.513113 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a64ef-3190-45b9-8162-938b306e046a None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:47.513490 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a64ef-3190-45b9-8162-938b306e046a None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:47.513803 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49504223-ae59-4702-9f49-1328f3d56792 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:47.513919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a64ef-3190-45b9-8162-938b306e046a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:47.524908 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 44/89] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:11:47 2022] GET /identity/v3/role_assignments?user.id=9d563cd2f3b848a3b1b5f14c04761740&scope.project.id=91bbd1bb0efc40338fac7e525cc596d1&role.id=83a904d35afc48fe9f8d55c0fd1597d8 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:47.525569 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49504223-ae59-4702-9f49-1328f3d56792 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:47.673318 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a64ef-3190-45b9-8162-938b306e046a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:47.675581 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a64ef-3190-45b9-8162-938b306e046a None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:47.726658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49504223-ae59-4702-9f49-1328f3d56792 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:47.768586 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2217047-f981-4bc4-a005-aa22b4c83788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:47.769515 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2217047-f981-4bc4-a005-aa22b4c83788 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:47.769969 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2217047-f981-4bc4-a005-aa22b4c83788 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:47.770439 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2217047-f981-4bc4-a005-aa22b4c83788 None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:47.771787 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2217047-f981-4bc4-a005-aa22b4c83788 None admin] RBAC: Authorizing `identity:get_project(project_id=91bbd1bb0efc40338fac7e525cc596d1)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:47.773416 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2217047-f981-4bc4-a005-aa22b4c83788 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:47.775336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 45/90] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:11:47 2022] GET /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:47.776341 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:47.776698 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2217047-f981-4bc4-a005-aa22b4c83788 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:47.833344 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:47.838730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 46/91] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:11:47.839829 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a64ef-3190-45b9-8162-938b306e046a None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:47.893054 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2217047-f981-4bc4-a005-aa22b4c83788 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:47.928967 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14eb353-84bb-4c59-adba-05fd5cb9aa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:47.929927 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14eb353-84bb-4c59-adba-05fd5cb9aa90 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:47.930399 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14eb353-84bb-4c59-adba-05fd5cb9aa90 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:47.930878 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14eb353-84bb-4c59-adba-05fd5cb9aa90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:47.951366 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a64ef-3190-45b9-8162-938b306e046a None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:48.001638 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704731b-333d-4b25-adda-02650f3a27a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:48.011294 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704731b-333d-4b25-adda-02650f3a27a9 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:48.011294 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704731b-333d-4b25-adda-02650f3a27a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:48.011294 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704731b-333d-4b25-adda-02650f3a27a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:48.011294 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704731b-333d-4b25-adda-02650f3a27a9 None admin] RBAC: Adding query filter params (role.id=097319c04e61414e80385247dbf5003a, scope.project.id=91bbd1bb0efc40338fac7e525cc596d1, user.id=9d563cd2f3b848a3b1b5f14c04761740) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:48.011294 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704731b-333d-4b25-adda-02650f3a27a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:48.011803 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14eb353-84bb-4c59-adba-05fd5cb9aa90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:48.012198 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704731b-333d-4b25-adda-02650f3a27a9 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:48.012266 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14eb353-84bb-4c59-adba-05fd5cb9aa90 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:48.019524 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 47/92] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:11:47 2022] GET /identity/v3/role_assignments?user.id=9d563cd2f3b848a3b1b5f14c04761740&scope.project.id=91bbd1bb0efc40338fac7e525cc596d1&role.id=097319c04e61414e80385247dbf5003a => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:48.020532 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704731b-333d-4b25-adda-02650f3a27a9 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:48.060210 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:48.079057 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:48.184546 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 46/93] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:11:48.193091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14eb353-84bb-4c59-adba-05fd5cb9aa90 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:48.300533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704731b-333d-4b25-adda-02650f3a27a9 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:48.355567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14eb353-84bb-4c59-adba-05fd5cb9aa90 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:48.411267 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27a78f-0ddb-4860-a885-c5b2140a2a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:48.411918 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27a78f-0ddb-4860-a885-c5b2140a2a5f None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:48.412200 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27a78f-0ddb-4860-a885-c5b2140a2a5f None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:48.412473 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27a78f-0ddb-4860-a885-c5b2140a2a5f None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:48.413644 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27a78f-0ddb-4860-a885-c5b2140a2a5f None admin] RBAC: Authorizing `identity:get_project(project_id=91bbd1bb0efc40338fac7e525cc596d1)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:48.415118 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27a78f-0ddb-4860-a885-c5b2140a2a5f None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:48.417359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 48/94] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:11:48 2022] GET /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1 => generated 298 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:48.418271 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fdaa1-b619-43b0-a9b8-381999c478d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:48.421096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fdaa1-b619-43b0-a9b8-381999c478d1 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:48.421561 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fdaa1-b619-43b0-a9b8-381999c478d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:48.421975 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fdaa1-b619-43b0-a9b8-381999c478d1 None admin] PATH_INFO: `/v3/projects/1d5d855878374541a719cd30fd1b583b` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:48.423336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18fdaa1-b619-43b0-a9b8-381999c478d1 None admin] RBAC: Authorizing `identity:get_project(project_id=1d5d855878374541a719cd30fd1b583b)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:48.425079 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18fdaa1-b619-43b0-a9b8-381999c478d1 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:48.425680 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27a78f-0ddb-4860-a885-c5b2140a2a5f None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:48.427106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 47/95] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:11:48 2022] GET /identity/v3/projects/1d5d855878374541a719cd30fd1b583b => generated 312 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:48.434505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fdaa1-b619-43b0-a9b8-381999c478d1 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:48.456241 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:48.555528 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:48.565574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27a78f-0ddb-4860-a885-c5b2140a2a5f None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:48.607532 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd92dcc-1d53-4ed3-b597-d907b3fa60f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:48.608173 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd92dcc-1d53-4ed3-b597-d907b3fa60f7 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:48.608457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd92dcc-1d53-4ed3-b597-d907b3fa60f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:48.608732 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd92dcc-1d53-4ed3-b597-d907b3fa60f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:48.609477 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd92dcc-1d53-4ed3-b597-d907b3fa60f7 None admin] RBAC: Adding query filter params (role.id=8fdfbc4aaf68468f89a5ae3450b8488d, scope.project.id=91bbd1bb0efc40338fac7e525cc596d1, user.id=7ffe86579b7344d19702549b20bcc927) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:48.609789 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd92dcc-1d53-4ed3-b597-d907b3fa60f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:48.610350 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fdaa1-b619-43b0-a9b8-381999c478d1 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:48.611293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd92dcc-1d53-4ed3-b597-d907b3fa60f7 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:48.617601 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 49/96] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:11:48 2022] GET /identity/v3/role_assignments?user.id=7ffe86579b7344d19702549b20bcc927&scope.project.id=91bbd1bb0efc40338fac7e525cc596d1&role.id=8fdfbc4aaf68468f89a5ae3450b8488d => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:48.663902 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14430104-6f46-41aa-b6cd-b2c649dd6bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:48.664539 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14430104-6f46-41aa-b6cd-b2c649dd6bea None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:48.664821 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14430104-6f46-41aa-b6cd-b2c649dd6bea None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:48.665097 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14430104-6f46-41aa-b6cd-b2c649dd6bea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:48.665836 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14430104-6f46-41aa-b6cd-b2c649dd6bea None admin] RBAC: Adding query filter params (role.id=83a904d35afc48fe9f8d55c0fd1597d8, scope.project.id=1d5d855878374541a719cd30fd1b583b, user.id=9d563cd2f3b848a3b1b5f14c04761740) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:48.666153 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14430104-6f46-41aa-b6cd-b2c649dd6bea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:48.667987 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14430104-6f46-41aa-b6cd-b2c649dd6bea None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:48.674942 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 48/97] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:11:48 2022] GET /identity/v3/role_assignments?user.id=9d563cd2f3b848a3b1b5f14c04761740&scope.project.id=1d5d855878374541a719cd30fd1b583b&role.id=83a904d35afc48fe9f8d55c0fd1597d8 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:50.184364 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8441607-65a3-49b2-8d20-f3dadf8206d1 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:50.184901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8441607-65a3-49b2-8d20-f3dadf8206d1 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:50.184901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8441607-65a3-49b2-8d20-f3dadf8206d1 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:50.186421 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 50/98] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:50.201161 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a1fb4-b188-4529-9cf1-de3b4289d4ab None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:50.201631 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a1fb4-b188-4529-9cf1-de3b4289d4ab None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:50.201725 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a1fb4-b188-4529-9cf1-de3b4289d4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:50.224811 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-190a1fb4-b188-4529-9cf1-de3b4289d4ab None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:50.226048 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-190a1fb4-b188-4529-9cf1-de3b4289d4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:50.314695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 49/99] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:11:50.647172 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabacbd7-6af8-4e2f-ac00-3a8d84806555 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:50.647518 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabacbd7-6af8-4e2f-ac00-3a8d84806555 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:50.647727 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabacbd7-6af8-4e2f-ac00-3a8d84806555 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:50.649215 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 51/100] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:50.655215 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfbba9-2f41-4a5d-bef0-3eafa5d7cf77 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:50.655508 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfbba9-2f41-4a5d-bef0-3eafa5d7cf77 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:50.655971 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfbba9-2f41-4a5d-bef0-3eafa5d7cf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:50.664476 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:50.679564 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-69dfbba9-2f41-4a5d-bef0-3eafa5d7cf77 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:50.680842 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-69dfbba9-2f41-4a5d-bef0-3eafa5d7cf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:50.756044 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 50/101] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:11:50.782922 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6f287-aa83-42ec-8435-f6a63639a7ec None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:50.783236 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6f287-aa83-42ec-8435-f6a63639a7ec None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:50.783495 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6f287-aa83-42ec-8435-f6a63639a7ec None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:50.785002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 52/102] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:50.790644 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cca867-c758-4260-8ce6-7cb0ac440a40 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:50.790932 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cca867-c758-4260-8ce6-7cb0ac440a40 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:50.791207 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cca867-c758-4260-8ce6-7cb0ac440a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:50.817372 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-47cca867-c758-4260-8ce6-7cb0ac440a40 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:50.818603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-47cca867-c758-4260-8ce6-7cb0ac440a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:50.887984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6f287-aa83-42ec-8435-f6a63639a7ec None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:50.925566 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 51/103] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:11:51.024200 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6f287-aa83-42ec-8435-f6a63639a7ec None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:51.066437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7233d-c16c-4884-94de-2617eae03bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:51.067156 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7233d-c16c-4884-94de-2617eae03bc1 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:51.067446 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7233d-c16c-4884-94de-2617eae03bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:51.067721 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7233d-c16c-4884-94de-2617eae03bc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:51.068856 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7233d-c16c-4884-94de-2617eae03bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:51.070300 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7233d-c16c-4884-94de-2617eae03bc1 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:51.071903 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 53/104] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:11:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:51.077711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cca867-c758-4260-8ce6-7cb0ac440a40 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:51.162874 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:51.206712 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cca867-c758-4260-8ce6-7cb0ac440a40 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:51.248086 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec40d0-2bd0-4826-9099-cd010c77edcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:51.248709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec40d0-2bd0-4826-9099-cd010c77edcc None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:51.248992 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec40d0-2bd0-4826-9099-cd010c77edcc None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:51.249268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec40d0-2bd0-4826-9099-cd010c77edcc None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:51.249922 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec40d0-2bd0-4826-9099-cd010c77edcc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:51.251427 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec40d0-2bd0-4826-9099-cd010c77edcc None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:51.321991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7233d-c16c-4884-94de-2617eae03bc1 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:51.356962 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:51.361096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 52/105] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Aug 19 19:11:51 2022] POST /identity/v3/projects => generated 302 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:11:51.371731 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79656c08-8629-418f-a8c3-23f8eb5a6e1f None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:51.372370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79656c08-8629-418f-a8c3-23f8eb5a6e1f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:51.372845 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79656c08-8629-418f-a8c3-23f8eb5a6e1f None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:51.374669 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 53/106] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:51.380006 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3299c5-f49b-40af-8bad-8f71dbac30f4 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:51.380608 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3299c5-f49b-40af-8bad-8f71dbac30f4 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:51.381104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3299c5-f49b-40af-8bad-8f71dbac30f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:51.405247 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-8c3299c5-f49b-40af-8bad-8f71dbac30f4 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:51.410995 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8c3299c5-f49b-40af-8bad-8f71dbac30f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:51.448422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7233d-c16c-4884-94de-2617eae03bc1 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:51.490949 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7bb4e-b24f-4864-9aba-859602dfc41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:51.491604 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7bb4e-b24f-4864-9aba-859602dfc41f None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:51.491887 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7bb4e-b24f-4864-9aba-859602dfc41f None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:51.492162 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7bb4e-b24f-4864-9aba-859602dfc41f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:51.513507 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7bb4e-b24f-4864-9aba-859602dfc41f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:11:51.519938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-55c7bb4e-b24f-4864-9aba-859602dfc41f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:11:51.519938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:11:51.519938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:11:51.519938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:11:51.519938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:11:51.519938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:11:51.519938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:11:51.519938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:11:51.519938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:11:51.519938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:11:51.519938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:11:51.519938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:11:51.519938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:11:51.519938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:11:51.519938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:11:51.519938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:11:51.520858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:11:51.520858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:11:51.520858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:11:51.520858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:11:51.520858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:11:51.520858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:11:51.520858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:11:51.520858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:11:51.520858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:11:51.520858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:11:51.520858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:11:51.520858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:11:51.520858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:11:51.520858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:11:51.520858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:11:51.520858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:11:51.521618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:11:51.521618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:11:51.521618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:11:51.521618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:11:51.521618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:11:51.521618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:11:51.521618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:11:51.521618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:11:51.521618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:11:51.521618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:11:51.521618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:11:51.521618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:11:51.521618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 54/107] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:11:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:11:51.527861 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7bb4e-b24f-4864-9aba-859602dfc41f None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:51.565382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 54/108] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:11:51.566628 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3299c5-f49b-40af-8bad-8f71dbac30f4 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:51.645618 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:51.660805 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:51.680011 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7bb4e-b24f-4864-9aba-859602dfc41f None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:51.709282 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3299c5-f49b-40af-8bad-8f71dbac30f4 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:51.727466 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d5447-4471-4674-9245-73b9e5ce4cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:51.728089 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d5447-4471-4674-9245-73b9e5ce4cb7 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:51.728376 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d5447-4471-4674-9245-73b9e5ce4cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:51.728652 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d5447-4471-4674-9245-73b9e5ce4cb7 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:51.729867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d5447-4471-4674-9245-73b9e5ce4cb7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:51.730328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d5447-4471-4674-9245-73b9e5ce4cb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:51.731891 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d5447-4471-4674-9245-73b9e5ce4cb7 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:51.746677 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 55/109] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:11:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:51.748324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d3b3c-3949-4071-8895-1142322cc83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:51.748988 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d3b3c-3949-4071-8895-1142322cc83e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:51.751174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d5447-4471-4674-9245-73b9e5ce4cb7 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:51.751890 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d3b3c-3949-4071-8895-1142322cc83e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:51.752176 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d3b3c-3949-4071-8895-1142322cc83e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:51.773701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d3b3c-3949-4071-8895-1142322cc83e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:11:51.780864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-bc4d3b3c-3949-4071-8895-1142322cc83e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:11:51.780864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:11:51.780864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:11:51.780864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:11:51.780864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:11:51.780864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:11:51.780864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:11:51.780864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:11:51.780864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:11:51.780864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:11:51.780864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:11:51.780864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:11:51.780864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:11:51.780864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:11:51.780864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:11:51.780864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:11:51.781875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:11:51.781875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:11:51.781875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:11:51.781875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:11:51.781875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:11:51.781875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:11:51.781875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:11:51.781875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:11:51.781875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:11:51.781875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:11:51.781875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:11:51.781875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:11:51.781875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:11:51.781875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:11:51.781875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:11:51.781875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:11:51.783002 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:11:51.783002 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:11:51.783002 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:11:51.783002 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:11:51.783002 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:11:51.783002 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:11:51.783002 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:11:51.783002 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:11:51.783002 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:11:51.783002 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:11:51.783002 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:11:51.783002 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:11:51.783002 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 55/110] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:11:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:11:51.790295 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d3b3c-3949-4071-8895-1142322cc83e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:51.940496 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d3b3c-3949-4071-8895-1142322cc83e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:51.949166 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:51.964864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d5447-4471-4674-9245-73b9e5ce4cb7 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:51.979499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8c332-4257-4ae4-84a7-1fc39be60399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:51.980385 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8c332-4257-4ae4-84a7-1fc39be60399 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:51.981236 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8c332-4257-4ae4-84a7-1fc39be60399 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:51.981623 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8c332-4257-4ae4-84a7-1fc39be60399 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:51.982401 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8c332-4257-4ae4-84a7-1fc39be60399 None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:51.983226 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8c332-4257-4ae4-84a7-1fc39be60399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:51.984885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8c332-4257-4ae4-84a7-1fc39be60399 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:52.000324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 56/111] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:11:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:52.004099 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f862ef8-f643-4121-8816-cf94dab2715d None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:52.005327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f862ef8-f643-4121-8816-cf94dab2715d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:52.017764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f862ef8-f643-4121-8816-cf94dab2715d None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:52.017764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 57/112] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:52.017764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb60ca-faaa-4933-a25c-9e7618c8eef0 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:52.017764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb60ca-faaa-4933-a25c-9e7618c8eef0 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:52.018295 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb60ca-faaa-4933-a25c-9e7618c8eef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:52.047046 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdc858-6d5f-48b0-8973-a2a60d70c676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:52.052153 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdc858-6d5f-48b0-8973-a2a60d70c676 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:52.052153 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdc858-6d5f-48b0-8973-a2a60d70c676 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:52.052153 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdc858-6d5f-48b0-8973-a2a60d70c676 None admin] PATH_INFO: `/v3/users/4d432d64e83b4919833ab22be0464f71` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:52.052393 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-72eb60ca-faaa-4933-a25c-9e7618c8eef0 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:52.054357 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-72eb60ca-faaa-4933-a25c-9e7618c8eef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:52.079360 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdc858-6d5f-48b0-8973-a2a60d70c676 None admin] RBAC: Authorizing `identity:get_user(user_id=4d432d64e83b4919833ab22be0464f71)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:52.081247 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdc858-6d5f-48b0-8973-a2a60d70c676 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:52.084251 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 56/113] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:11:51 2022] GET /identity/v3/users/4d432d64e83b4919833ab22be0464f71 => generated 289 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:52.084251 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdc858-6d5f-48b0-8973-a2a60d70c676 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:52.089329 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:52.164009 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 58/114] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:11:52.165460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb60ca-faaa-4933-a25c-9e7618c8eef0 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:52.210797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdc858-6d5f-48b0-8973-a2a60d70c676 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:52.250856 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16fa79-31a2-4dcf-a570-258798f6da8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:52.251703 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16fa79-31a2-4dcf-a570-258798f6da8f None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:52.252066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16fa79-31a2-4dcf-a570-258798f6da8f None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:52.252412 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16fa79-31a2-4dcf-a570-258798f6da8f None admin] PATH_INFO: `/v3/users/9d563cd2f3b848a3b1b5f14c04761740` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:52.253801 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16fa79-31a2-4dcf-a570-258798f6da8f None admin] RBAC: Authorizing `identity:get_user(user_id=9d563cd2f3b848a3b1b5f14c04761740)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:52.255439 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16fa79-31a2-4dcf-a570-258798f6da8f None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:52.257511 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 57/115] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:11:52 2022] GET /identity/v3/users/9d563cd2f3b848a3b1b5f14c04761740 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:52.263015 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16fa79-31a2-4dcf-a570-258798f6da8f None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:52.320778 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:52.325299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb60ca-faaa-4933-a25c-9e7618c8eef0 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:52.397742 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5a596-a3da-432d-98f6-31d4b7b9e247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:52.398704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5a596-a3da-432d-98f6-31d4b7b9e247 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:52.399223 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5a596-a3da-432d-98f6-31d4b7b9e247 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:52.399954 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:52.400791 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5a596-a3da-432d-98f6-31d4b7b9e247 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:52.413988 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5a596-a3da-432d-98f6-31d4b7b9e247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:11:52.420743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-c0e5a596-a3da-432d-98f6-31d4b7b9e247 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:11:52.420743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:11:52.420743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:11:52.420743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:11:52.420743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:11:52.420743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:11:52.420743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:11:52.420743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:11:52.420743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:11:52.420743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:11:52.420743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:11:52.420743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:11:52.420743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:11:52.420743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:11:52.420743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:11:52.420743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:11:52.427318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:11:52.427318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:11:52.427318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:11:52.427318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:11:52.427318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:11:52.427318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:11:52.427318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:11:52.427318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:11:52.427318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:11:52.427318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:11:52.427318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:11:52.427318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:11:52.427318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:11:52.427318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:11:52.427318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:11:52.427318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:11:52.428063 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:11:52.428063 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:11:52.428063 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:11:52.428063 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:11:52.428063 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:11:52.428063 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:11:52.428063 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:11:52.428063 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:11:52.428063 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:11:52.428063 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:11:52.428063 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:11:52.428063 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:11:52.428063 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 59/116] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:11:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:11:52.428063 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bde03-ca99-427c-a7e9-bea7cbb68612 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:52.428737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bde03-ca99-427c-a7e9-bea7cbb68612 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:52.428737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bde03-ca99-427c-a7e9-bea7cbb68612 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:52.428737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 60/117] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:52.428737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bde03-ca99-427c-a7e9-bea7cbb68612 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:52.444723 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16fa79-31a2-4dcf-a570-258798f6da8f None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:52.491747 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9855f-c686-476e-9397-e8c73a541d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:52.493012 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9855f-c686-476e-9397-e8c73a541d7a None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:52.493690 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9855f-c686-476e-9397-e8c73a541d7a None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:52.494130 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9855f-c686-476e-9397-e8c73a541d7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:52.556145 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bde03-ca99-427c-a7e9-bea7cbb68612 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:52.576938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9855f-c686-476e-9397-e8c73a541d7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:52.578433 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9855f-c686-476e-9397-e8c73a541d7a None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:52.606599 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7d754-55e3-4199-a78d-c6203bce2cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:52.607243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7d754-55e3-4199-a78d-c6203bce2cd4 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:52.607527 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7d754-55e3-4199-a78d-c6203bce2cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:52.607829 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7d754-55e3-4199-a78d-c6203bce2cd4 None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:52.608951 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7d754-55e3-4199-a78d-c6203bce2cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=91bbd1bb0efc40338fac7e525cc596d1)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:52.610410 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7d754-55e3-4199-a78d-c6203bce2cd4 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:52.612134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 61/118] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:11:52 2022] GET /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:52.613234 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeb460-e1a5-4b56-9135-b2a424076527 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:52.613544 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeb460-e1a5-4b56-9135-b2a424076527 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:52.613815 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeb460-e1a5-4b56-9135-b2a424076527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:52.632125 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-4adeb460-e1a5-4b56-9135-b2a424076527 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:52.633345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4adeb460-e1a5-4b56-9135-b2a424076527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:52.656286 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:52.672987 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:52.708231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 62/119] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:11:52.708960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 58/120] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:11:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:11:52.709084 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adeb460-e1a5-4b56-9135-b2a424076527 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:52.710130 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9855f-c686-476e-9397-e8c73a541d7a None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:52.845011 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adeb460-e1a5-4b56-9135-b2a424076527 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:52.850025 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9855f-c686-476e-9397-e8c73a541d7a None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:52.891582 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d714e-5ef2-4780-877c-de9313f33366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:52.892392 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d714e-5ef2-4780-877c-de9313f33366 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:52.892773 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d714e-5ef2-4780-877c-de9313f33366 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:52.893052 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d714e-5ef2-4780-877c-de9313f33366 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:52.893723 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d714e-5ef2-4780-877c-de9313f33366 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:52.894028 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d714e-5ef2-4780-877c-de9313f33366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:52.895973 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d714e-5ef2-4780-877c-de9313f33366 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:52.904968 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d68994-edc9-49a7-96ff-bc44d1e31bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:52.910495 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 63/121] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:11:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:52.910495 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d714e-5ef2-4780-877c-de9313f33366 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:52.910713 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d68994-edc9-49a7-96ff-bc44d1e31bc4 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:52.911058 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d68994-edc9-49a7-96ff-bc44d1e31bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:52.911224 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d68994-edc9-49a7-96ff-bc44d1e31bc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:52.922987 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d68994-edc9-49a7-96ff-bc44d1e31bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:11:52.927764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-d8d68994-edc9-49a7-96ff-bc44d1e31bc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:11:52.927764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:11:52.927764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:11:52.927764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:11:52.927764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:11:52.927764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:11:52.927764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:11:52.927764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:11:52.927764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:11:52.927764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:11:52.927764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:11:52.927764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:11:52.927764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:11:52.927764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:11:52.927764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:11:52.927764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:11:52.928645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:11:52.928645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:11:52.928645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:11:52.928645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:11:52.928645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:11:52.928645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:11:52.928645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:11:52.928645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:11:52.928645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:11:52.928645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:11:52.928645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:11:52.928645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:11:52.928645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:11:52.928645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:11:52.928645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:11:52.928645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:11:52.929411 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:11:52.929411 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:11:52.929411 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:11:52.929411 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:11:52.929411 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:11:52.929411 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:11:52.929411 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:11:52.929411 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:11:52.929411 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:11:52.929411 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:11:52.929411 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:11:52.929411 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:11:52.929411 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 59/122] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Aug 19 19:11:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:11:52.930056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d68994-edc9-49a7-96ff-bc44d1e31bc4 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:52.936196 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:52.963987 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:53.025305 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d714e-5ef2-4780-877c-de9313f33366 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:53.038143 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d68994-edc9-49a7-96ff-bc44d1e31bc4 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:53.062280 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0b56e-e0d0-4e81-b9a5-18ab30bb8b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:53.063066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0b56e-e0d0-4e81-b9a5-18ab30bb8b87 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:53.063481 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0b56e-e0d0-4e81-b9a5-18ab30bb8b87 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:53.063839 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0b56e-e0d0-4e81-b9a5-18ab30bb8b87 None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1/users/9d563cd2f3b848a3b1b5f14c04761740/roles/83a904d35afc48fe9f8d55c0fd1597d8` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:53.066058 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0b56e-e0d0-4e81-b9a5-18ab30bb8b87 None admin] RBAC: Authorizing `identity:create_grant(project_id=91bbd1bb0efc40338fac7e525cc596d1, user_id=9d563cd2f3b848a3b1b5f14c04761740, role_id=83a904d35afc48fe9f8d55c0fd1597d8)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:53.067521 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0b56e-e0d0-4e81-b9a5-18ab30bb8b87 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:53.076212 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2fbe8-ed39-4f43-ba10-cfe29af20c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:53.076842 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2fbe8-ed39-4f43-ba10-cfe29af20c23 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:53.077122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2fbe8-ed39-4f43-ba10-cfe29af20c23 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:53.077394 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2fbe8-ed39-4f43-ba10-cfe29af20c23 None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:53.078565 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2fbe8-ed39-4f43-ba10-cfe29af20c23 None admin] RBAC: Authorizing `identity:get_project(project_id=91bbd1bb0efc40338fac7e525cc596d1)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:53.080002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2fbe8-ed39-4f43-ba10-cfe29af20c23 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:53.081625 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 60/123] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:11:52 2022] GET /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:53.082387 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2fbe8-ed39-4f43-ba10-cfe29af20c23 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:53.118589 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 64/124] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Aug 19 19:11:52 2022] PUT /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1/users/9d563cd2f3b848a3b1b5f14c04761740/roles/83a904d35afc48fe9f8d55c0fd1597d8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:11:53.119874 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0b56e-e0d0-4e81-b9a5-18ab30bb8b87 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:53.210808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:53.215503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2fbe8-ed39-4f43-ba10-cfe29af20c23 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:53.230273 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:53.254646 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0b56e-e0d0-4e81-b9a5-18ab30bb8b87 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:53.264469 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd41258-a685-4ac7-a9b7-8d0f99089d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:53.265833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd41258-a685-4ac7-a9b7-8d0f99089d92 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:53.266284 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd41258-a685-4ac7-a9b7-8d0f99089d92 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:53.267210 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd41258-a685-4ac7-a9b7-8d0f99089d92 None admin] PATH_INFO: `/v3/users/9d563cd2f3b848a3b1b5f14c04761740` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:53.273642 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd41258-a685-4ac7-a9b7-8d0f99089d92 None admin] RBAC: Authorizing `identity:get_user(user_id=9d563cd2f3b848a3b1b5f14c04761740)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:53.273642 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd41258-a685-4ac7-a9b7-8d0f99089d92 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:53.273642 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 61/125] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:11:53 2022] GET /identity/v3/users/9d563cd2f3b848a3b1b5f14c04761740 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:53.274837 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd41258-a685-4ac7-a9b7-8d0f99089d92 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:53.299348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed8000-f130-4bed-ae21-67a66a87313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:53.300259 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed8000-f130-4bed-ae21-67a66a87313e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:53.300701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed8000-f130-4bed-ae21-67a66a87313e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:53.301071 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed8000-f130-4bed-ae21-67a66a87313e None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:53.301903 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed8000-f130-4bed-ae21-67a66a87313e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:53.302307 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed8000-f130-4bed-ae21-67a66a87313e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:53.303993 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed8000-f130-4bed-ae21-67a66a87313e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:53.313575 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 65/126] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:11:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:53.314252 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed8000-f130-4bed-ae21-67a66a87313e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:53.408360 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd41258-a685-4ac7-a9b7-8d0f99089d92 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:53.447719 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed8000-f130-4bed-ae21-67a66a87313e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:53.453359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7f099-d605-441a-bddc-0a8c69f1557a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:53.454118 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7f099-d605-441a-bddc-0a8c69f1557a None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:53.454500 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7f099-d605-441a-bddc-0a8c69f1557a None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:53.454902 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7f099-d605-441a-bddc-0a8c69f1557a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:53.470719 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7f099-d605-441a-bddc-0a8c69f1557a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:11:53.479129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-65b7f099-d605-441a-bddc-0a8c69f1557a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:11:53.479129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:11:53.479129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:11:53.479129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:11:53.479129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:11:53.479129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:11:53.479129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:11:53.479129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:11:53.479129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:11:53.479129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:11:53.479129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:11:53.479129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:11:53.479129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:11:53.479129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:11:53.479129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:11:53.479129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:11:53.480313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:11:53.480313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:11:53.480313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:11:53.480313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:11:53.480313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:11:53.480313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:11:53.480313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:11:53.480313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:11:53.480313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:11:53.480313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:11:53.480313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:11:53.480313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:11:53.480313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:11:53.480313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:11:53.480313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:11:53.480313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:11:53.481248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:11:53.481248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:11:53.481248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:11:53.481248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:11:53.481248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:11:53.481248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:11:53.481248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:11:53.481248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:11:53.481248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:11:53.481248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:11:53.481248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:11:53.481248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:11:53.486040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 62/127] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:11:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:11:53.486952 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7f099-d605-441a-bddc-0a8c69f1557a None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:53.490405 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2468e-8ba6-4331-8ac6-cb2223c8fc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:53.491252 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2468e-8ba6-4331-8ac6-cb2223c8fc83 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:53.491680 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2468e-8ba6-4331-8ac6-cb2223c8fc83 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:53.492065 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2468e-8ba6-4331-8ac6-cb2223c8fc83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:53.492923 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2468e-8ba6-4331-8ac6-cb2223c8fc83 None admin] RBAC: Adding query filter params (role.id=14b4522936a24e78a58d9f0dcae537be, scope.project.id=91bbd1bb0efc40338fac7e525cc596d1, user.id=4d432d64e83b4919833ab22be0464f71) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:53.493341 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2468e-8ba6-4331-8ac6-cb2223c8fc83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:53.495536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2468e-8ba6-4331-8ac6-cb2223c8fc83 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:53.502099 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 66/128] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:11:53 2022] GET /identity/v3/role_assignments?user.id=4d432d64e83b4919833ab22be0464f71&scope.project.id=91bbd1bb0efc40338fac7e525cc596d1&role.id=14b4522936a24e78a58d9f0dcae537be => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:53.513452 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2468e-8ba6-4331-8ac6-cb2223c8fc83 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:53.542940 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:53.564142 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:53.644642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2468e-8ba6-4331-8ac6-cb2223c8fc83 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:53.702717 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a215ae9-f7af-4781-8aa6-27ad80ec0508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:53.703286 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a215ae9-f7af-4781-8aa6-27ad80ec0508 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:53.703567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a215ae9-f7af-4781-8aa6-27ad80ec0508 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:53.703839 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a215ae9-f7af-4781-8aa6-27ad80ec0508 None admin] PATH_INFO: `/v3/users/7ffe86579b7344d19702549b20bcc927` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:53.705072 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a215ae9-f7af-4781-8aa6-27ad80ec0508 None admin] RBAC: Authorizing `identity:get_user(user_id=7ffe86579b7344d19702549b20bcc927)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:53.706575 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a215ae9-f7af-4781-8aa6-27ad80ec0508 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:53.708463 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 67/129] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:11:53 2022] GET /identity/v3/users/7ffe86579b7344d19702549b20bcc927 => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:53.709025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a215ae9-f7af-4781-8aa6-27ad80ec0508 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:53.742953 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7f099-d605-441a-bddc-0a8c69f1557a None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:53.792745 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5633f3-92c2-497b-ae1c-b3d2d77ce965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:53.793744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5633f3-92c2-497b-ae1c-b3d2d77ce965 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:53.794248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5633f3-92c2-497b-ae1c-b3d2d77ce965 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:53.794744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5633f3-92c2-497b-ae1c-b3d2d77ce965 None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:53.797271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5633f3-92c2-497b-ae1c-b3d2d77ce965 None admin] RBAC: Authorizing `identity:get_project(project_id=91bbd1bb0efc40338fac7e525cc596d1)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:53.799037 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5633f3-92c2-497b-ae1c-b3d2d77ce965 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:53.805526 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 63/130] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:11:53 2022] GET /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1 => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:53.806552 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5633f3-92c2-497b-ae1c-b3d2d77ce965 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:53.846243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:53.916429 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a215ae9-f7af-4781-8aa6-27ad80ec0508 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:53.955059 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d741dad-972f-417f-96e5-91926efc16c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:53.956249 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d741dad-972f-417f-96e5-91926efc16c5 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:53.956778 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d741dad-972f-417f-96e5-91926efc16c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:53.957284 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d741dad-972f-417f-96e5-91926efc16c5 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:53.958151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d741dad-972f-417f-96e5-91926efc16c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:53.958731 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d741dad-972f-417f-96e5-91926efc16c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:53.960463 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d741dad-972f-417f-96e5-91926efc16c5 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:53.962586 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:53.973353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 68/131] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:11:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:53.974542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5633f3-92c2-497b-ae1c-b3d2d77ce965 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:53.979536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d741dad-972f-417f-96e5-91926efc16c5 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:54.015261 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d70a4-47bc-41d8-9cc5-e9fccfbf673b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:54.016005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d70a4-47bc-41d8-9cc5-e9fccfbf673b None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:54.016290 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d70a4-47bc-41d8-9cc5-e9fccfbf673b None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:54.016568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d70a4-47bc-41d8-9cc5-e9fccfbf673b None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:54.018247 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d70a4-47bc-41d8-9cc5-e9fccfbf673b None admin] RBAC: Authorizing `identity:get_project(project_id=91bbd1bb0efc40338fac7e525cc596d1)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:54.019587 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d70a4-47bc-41d8-9cc5-e9fccfbf673b None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:54.021673 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 64/132] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:11:53 2022] GET /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:54.022224 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d70a4-47bc-41d8-9cc5-e9fccfbf673b None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:54.131477 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d741dad-972f-417f-96e5-91926efc16c5 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:54.169059 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d70a4-47bc-41d8-9cc5-e9fccfbf673b None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:54.179314 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00452d97-b832-4684-bc84-c77aafd19609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:54.180693 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00452d97-b832-4684-bc84-c77aafd19609 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:54.181708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00452d97-b832-4684-bc84-c77aafd19609 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:54.182739 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00452d97-b832-4684-bc84-c77aafd19609 None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1/users/9d563cd2f3b848a3b1b5f14c04761740/roles/097319c04e61414e80385247dbf5003a` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:54.186154 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00452d97-b832-4684-bc84-c77aafd19609 None admin] RBAC: Authorizing `identity:create_grant(project_id=91bbd1bb0efc40338fac7e525cc596d1, user_id=9d563cd2f3b848a3b1b5f14c04761740, role_id=097319c04e61414e80385247dbf5003a)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:54.188538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00452d97-b832-4684-bc84-c77aafd19609 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:54.191827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:54.210718 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1af511-8234-4f56-b9af-5cd3e079d2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:54.210718 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1af511-8234-4f56-b9af-5cd3e079d2aa None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:54.210718 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1af511-8234-4f56-b9af-5cd3e079d2aa None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:54.210718 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1af511-8234-4f56-b9af-5cd3e079d2aa None admin] PATH_INFO: `/v3/users/9d563cd2f3b848a3b1b5f14c04761740` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:54.211079 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1af511-8234-4f56-b9af-5cd3e079d2aa None admin] RBAC: Authorizing `identity:get_user(user_id=9d563cd2f3b848a3b1b5f14c04761740)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:54.211079 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1af511-8234-4f56-b9af-5cd3e079d2aa None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:54.217914 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 65/133] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:11:54 2022] GET /identity/v3/users/9d563cd2f3b848a3b1b5f14c04761740 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:54.217914 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1af511-8234-4f56-b9af-5cd3e079d2aa None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:54.249219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:54.278852 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 69/134] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Aug 19 19:11:53 2022] PUT /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1/users/9d563cd2f3b848a3b1b5f14c04761740/roles/097319c04e61414e80385247dbf5003a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:11:54.280717 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88853026-a2c0-4cf8-9195-b52ac65e6eb1 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:54.281212 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88853026-a2c0-4cf8-9195-b52ac65e6eb1 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:54.281660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88853026-a2c0-4cf8-9195-b52ac65e6eb1 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:54.283726 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 70/135] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:54.285520 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88853026-a2c0-4cf8-9195-b52ac65e6eb1 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:54.393212 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1af511-8234-4f56-b9af-5cd3e079d2aa None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:54.481760 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88853026-a2c0-4cf8-9195-b52ac65e6eb1 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:54.501864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d43555-f40e-4af4-8f55-3b27ef4bb454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:54.502667 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d43555-f40e-4af4-8f55-3b27ef4bb454 None admin] REQUEST_METHOD: `PUT` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:54.503042 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d43555-f40e-4af4-8f55-3b27ef4bb454 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:54.503389 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d43555-f40e-4af4-8f55-3b27ef4bb454 None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1/users/7ffe86579b7344d19702549b20bcc927/roles/8fdfbc4aaf68468f89a5ae3450b8488d` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:54.505989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d43555-f40e-4af4-8f55-3b27ef4bb454 None admin] RBAC: Authorizing `identity:create_grant(project_id=91bbd1bb0efc40338fac7e525cc596d1, user_id=7ffe86579b7344d19702549b20bcc927, role_id=8fdfbc4aaf68468f89a5ae3450b8488d)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:54.507984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d43555-f40e-4af4-8f55-3b27ef4bb454 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:54.528134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d1e75-9c8c-4ca9-b228-6f0388e6ce12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:54.528994 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d1e75-9c8c-4ca9-b228-6f0388e6ce12 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:54.529274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d1e75-9c8c-4ca9-b228-6f0388e6ce12 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:54.529547 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d1e75-9c8c-4ca9-b228-6f0388e6ce12 None admin] PATH_INFO: `/v3/projects/1d5d855878374541a719cd30fd1b583b` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:54.531041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d1e75-9c8c-4ca9-b228-6f0388e6ce12 None admin] RBAC: Authorizing `identity:get_project(project_id=1d5d855878374541a719cd30fd1b583b)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:54.532181 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d1e75-9c8c-4ca9-b228-6f0388e6ce12 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:54.534027 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 71/136] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:11:54 2022] GET /identity/v3/projects/1d5d855878374541a719cd30fd1b583b => generated 312 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:54.537769 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba39988-cac3-4b3d-b1c4-8a6c6d635853 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:54.537769 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba39988-cac3-4b3d-b1c4-8a6c6d635853 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:54.537769 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba39988-cac3-4b3d-b1c4-8a6c6d635853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:54.556684 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-4ba39988-cac3-4b3d-b1c4-8a6c6d635853 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:54.558788 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4ba39988-cac3-4b3d-b1c4-8a6c6d635853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:54.581779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 66/137] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Aug 19 19:11:54 2022] PUT /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1/users/7ffe86579b7344d19702549b20bcc927/roles/8fdfbc4aaf68468f89a5ae3450b8488d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:11:54.582824 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d43555-f40e-4af4-8f55-3b27ef4bb454 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:54.678932 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:54.691840 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 72/138] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:11:54.764483 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:54.778174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d43555-f40e-4af4-8f55-3b27ef4bb454 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:54.827866 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fd1d1-8214-4c3a-a76a-e2c2bd8c899f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:54.828553 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fd1d1-8214-4c3a-a76a-e2c2bd8c899f None admin] REQUEST_METHOD: `PUT` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:54.828835 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fd1d1-8214-4c3a-a76a-e2c2bd8c899f None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:54.829112 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fd1d1-8214-4c3a-a76a-e2c2bd8c899f None admin] PATH_INFO: `/v3/projects/1d5d855878374541a719cd30fd1b583b/users/9d563cd2f3b848a3b1b5f14c04761740/roles/83a904d35afc48fe9f8d55c0fd1597d8` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:54.831136 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fd1d1-8214-4c3a-a76a-e2c2bd8c899f None admin] RBAC: Authorizing `identity:create_grant(project_id=1d5d855878374541a719cd30fd1b583b, user_id=9d563cd2f3b848a3b1b5f14c04761740, role_id=83a904d35afc48fe9f8d55c0fd1597d8)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:54.832595 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fd1d1-8214-4c3a-a76a-e2c2bd8c899f None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:54.924847 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 67/139] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Aug 19 19:11:54 2022] PUT /identity/v3/projects/1d5d855878374541a719cd30fd1b583b/users/9d563cd2f3b848a3b1b5f14c04761740/roles/83a904d35afc48fe9f8d55c0fd1597d8 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:11:55.137371 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba39988-cac3-4b3d-b1c4-8a6c6d635853 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:55.249394 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba39988-cac3-4b3d-b1c4-8a6c6d635853 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:55.287408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bcca1-a862-40e0-ba82-d9767542dc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:55.288054 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bcca1-a862-40e0-ba82-d9767542dc84 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:55.288332 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bcca1-a862-40e0-ba82-d9767542dc84 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:55.288603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bcca1-a862-40e0-ba82-d9767542dc84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:55.290071 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bcca1-a862-40e0-ba82-d9767542dc84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:55.291224 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bcca1-a862-40e0-ba82-d9767542dc84 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:55.297494 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 73/140] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:11:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:55.300015 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fd1d1-8214-4c3a-a76a-e2c2bd8c899f None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:55.411100 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fd1d1-8214-4c3a-a76a-e2c2bd8c899f None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:55.449844 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f217a91-6d89-4d6d-849c-c79935a45f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:55.450453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f217a91-6d89-4d6d-849c-c79935a45f36 None admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:55.450761 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f217a91-6d89-4d6d-849c-c79935a45f36 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:55.451030 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f217a91-6d89-4d6d-849c-c79935a45f36 None admin] PATH_INFO: `/v3/users` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:55.451670 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f217a91-6d89-4d6d-849c-c79935a45f36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:55.453122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f217a91-6d89-4d6d-849c-c79935a45f36 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:55.576307 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 68/141] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Aug 19 19:11:55 2022] POST /identity/v3/users => generated 283 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:11:55.959109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8d639-0608-41ba-a9e9-f16553ed83e2 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:55.959655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8d639-0608-41ba-a9e9-f16553ed83e2 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:55.959870 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8d639-0608-41ba-a9e9-f16553ed83e2 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:55.961255 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 74/142] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:55.967618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe0cee-6fc1-495d-bdee-f1eb354ccec4 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:55.967908 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe0cee-6fc1-495d-bdee-f1eb354ccec4 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:55.968184 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe0cee-6fc1-495d-bdee-f1eb354ccec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:55.994978 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-debe0cee-6fc1-495d-bdee-f1eb354ccec4 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:55.997545 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-debe0cee-6fc1-495d-bdee-f1eb354ccec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:55.999694 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:56.081021 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 69/143] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:11:56.396297 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ed0cc-b6cc-4fb1-b893-e39482c6dc7e None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:56.396663 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ed0cc-b6cc-4fb1-b893-e39482c6dc7e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:56.396867 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ed0cc-b6cc-4fb1-b893-e39482c6dc7e None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:56.398345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 75/144] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:56.404164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdee718-ae39-425d-a4f7-479f96d3c2ea None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:56.404458 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdee718-ae39-425d-a4f7-479f96d3c2ea None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:56.404732 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdee718-ae39-425d-a4f7-479f96d3c2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:56.431507 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-fcdee718-ae39-425d-a4f7-479f96d3c2ea None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:56.433238 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-fcdee718-ae39-425d-a4f7-479f96d3c2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:56.516619 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 70/145] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:11:56.524820 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ed0cc-b6cc-4fb1-b893-e39482c6dc7e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:56.604906 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:56.648137 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ed0cc-b6cc-4fb1-b893-e39482c6dc7e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:56.685897 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59574e-280e-4b7e-90f6-dc7f989d6c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:56.686633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59574e-280e-4b7e-90f6-dc7f989d6c63 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:56.686908 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59574e-280e-4b7e-90f6-dc7f989d6c63 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:56.687175 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59574e-280e-4b7e-90f6-dc7f989d6c63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:56.699977 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59574e-280e-4b7e-90f6-dc7f989d6c63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:11:56.704772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-0b59574e-280e-4b7e-90f6-dc7f989d6c63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:11:56.704772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:11:56.704772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:11:56.704772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:11:56.704772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:11:56.704772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:11:56.704772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:11:56.704772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:11:56.704772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:11:56.704772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:11:56.704772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:11:56.704772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:11:56.704772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:11:56.704772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:11:56.704772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:11:56.704772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:11:56.705596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:11:56.705596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:11:56.705596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:11:56.705596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:11:56.705596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:11:56.705596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:11:56.705596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:11:56.705596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:11:56.705596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:11:56.705596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:11:56.705596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:11:56.705596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:11:56.705596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:11:56.705596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:11:56.705596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:11:56.705596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:11:56.706370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:11:56.706370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:11:56.706370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:11:56.706370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:11:56.706370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:11:56.706370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:11:56.706370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:11:56.706370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:11:56.706370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:11:56.706370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:11:56.706370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:11:56.706370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:11:56.706370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 76/146] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:11:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:11:56.714037 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdee718-ae39-425d-a4f7-479f96d3c2ea None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:56.795707 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:56.831338 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdee718-ae39-425d-a4f7-479f96d3c2ea None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:56.867599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bf2ce-052b-4dd7-b8ea-38855512d84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:56.868212 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bf2ce-052b-4dd7-b8ea-38855512d84f None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:56.868487 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bf2ce-052b-4dd7-b8ea-38855512d84f None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:56.868754 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bf2ce-052b-4dd7-b8ea-38855512d84f None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:56.869420 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bf2ce-052b-4dd7-b8ea-38855512d84f None admin] RBAC: Adding query filter params (name=member) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:56.870240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bf2ce-052b-4dd7-b8ea-38855512d84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:56.871642 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bf2ce-052b-4dd7-b8ea-38855512d84f None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:56.883003 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 71/147] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:11:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:56.893182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59574e-280e-4b7e-90f6-dc7f989d6c63 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:56.978067 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bf2ce-052b-4dd7-b8ea-38855512d84f None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:57.011917 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59574e-280e-4b7e-90f6-dc7f989d6c63 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:57.034796 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:57.049910 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed80ff-35bf-4302-8f73-12293dc4a21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:57.050672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed80ff-35bf-4302-8f73-12293dc4a21b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:57.051879 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed80ff-35bf-4302-8f73-12293dc4a21b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:57.051879 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed80ff-35bf-4302-8f73-12293dc4a21b None admin] PATH_INFO: `/v3/users/9d563cd2f3b848a3b1b5f14c04761740` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:57.052921 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed80ff-35bf-4302-8f73-12293dc4a21b None admin] RBAC: Authorizing `identity:get_user(user_id=9d563cd2f3b848a3b1b5f14c04761740)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:57.054687 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed80ff-35bf-4302-8f73-12293dc4a21b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:57.056475 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 77/148] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:11:56 2022] GET /identity/v3/users/9d563cd2f3b848a3b1b5f14c04761740 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:57.067618 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed80ff-35bf-4302-8f73-12293dc4a21b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:57.118493 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bf2ce-052b-4dd7-b8ea-38855512d84f None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:57.168547 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:57.179897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04976f23-cda7-4574-91c7-93dd4f1bee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:57.180542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04976f23-cda7-4574-91c7-93dd4f1bee7b None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:57.180819 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04976f23-cda7-4574-91c7-93dd4f1bee7b None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:57.181087 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04976f23-cda7-4574-91c7-93dd4f1bee7b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:57.200721 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04976f23-cda7-4574-91c7-93dd4f1bee7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:11:57.207178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-04976f23-cda7-4574-91c7-93dd4f1bee7b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:11:57.207178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:11:57.207178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:11:57.207178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:11:57.207178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:11:57.207178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:11:57.207178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:11:57.207178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:11:57.207178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:11:57.207178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:11:57.207178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:11:57.207178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:11:57.207178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:11:57.207178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:11:57.207178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:11:57.207178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:11:57.214752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:11:57.214752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:11:57.214752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:11:57.214752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:11:57.214752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:11:57.214752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:11:57.214752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:11:57.214752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:11:57.214752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:11:57.214752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:11:57.214752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:11:57.214752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:11:57.214752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:11:57.214752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:11:57.214752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:11:57.214752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:11:57.215520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:11:57.215520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:11:57.215520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:11:57.215520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:11:57.215520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:11:57.215520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:11:57.215520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:11:57.215520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:11:57.215520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:11:57.215520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:11:57.215520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:11:57.215520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:11:57.215520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 72/149] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:11:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:11:57.215520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04976f23-cda7-4574-91c7-93dd4f1bee7b None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:57.265421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed80ff-35bf-4302-8f73-12293dc4a21b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:57.368868 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d22e41-85f2-4910-81e7-6c388afde6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:57.370385 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d22e41-85f2-4910-81e7-6c388afde6be None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:57.370916 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d22e41-85f2-4910-81e7-6c388afde6be None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:57.371419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d22e41-85f2-4910-81e7-6c388afde6be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:57.422747 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04976f23-cda7-4574-91c7-93dd4f1bee7b None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:57.484770 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:57.487814 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc1adb-46a5-4de0-8237-d112610a8a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:57.488570 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc1adb-46a5-4de0-8237-d112610a8a66 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:57.488845 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc1adb-46a5-4de0-8237-d112610a8a66 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:57.489113 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc1adb-46a5-4de0-8237-d112610a8a66 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:57.489780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc1adb-46a5-4de0-8237-d112610a8a66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:57.490078 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc1adb-46a5-4de0-8237-d112610a8a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:57.491665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc1adb-46a5-4de0-8237-d112610a8a66 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:57.508794 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 73/150] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:11:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:57.515633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc1adb-46a5-4de0-8237-d112610a8a66 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:57.520419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d22e41-85f2-4910-81e7-6c388afde6be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:57.522128 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d22e41-85f2-4910-81e7-6c388afde6be None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:57.646988 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:57.727125 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 78/151] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:11:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:11:57.733506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d22e41-85f2-4910-81e7-6c388afde6be None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:57.755073 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc1adb-46a5-4de0-8237-d112610a8a66 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:57.810276 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78ef2d-6764-4f73-b89b-5bb06399d32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:57.811323 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78ef2d-6764-4f73-b89b-5bb06399d32d None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:57.811835 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78ef2d-6764-4f73-b89b-5bb06399d32d None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:57.812297 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78ef2d-6764-4f73-b89b-5bb06399d32d None admin] PATH_INFO: `/v3/users/4d432d64e83b4919833ab22be0464f71` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:57.813670 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78ef2d-6764-4f73-b89b-5bb06399d32d None admin] RBAC: Authorizing `identity:get_user(user_id=4d432d64e83b4919833ab22be0464f71)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:57.815346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78ef2d-6764-4f73-b89b-5bb06399d32d None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:57.819274 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 74/152] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:11:57 2022] GET /identity/v3/users/4d432d64e83b4919833ab22be0464f71 => generated 289 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:57.825741 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78ef2d-6764-4f73-b89b-5bb06399d32d None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:57.892861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:57.917050 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d22e41-85f2-4910-81e7-6c388afde6be None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:57.980411 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e15fa1-c26c-4d87-aeb4-058d63192d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:57.981079 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e15fa1-c26c-4d87-aeb4-058d63192d01 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:57.981362 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e15fa1-c26c-4d87-aeb4-058d63192d01 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:57.981641 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e15fa1-c26c-4d87-aeb4-058d63192d01 None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:57.983163 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e15fa1-c26c-4d87-aeb4-058d63192d01 None admin] RBAC: Authorizing `identity:get_project(project_id=91bbd1bb0efc40338fac7e525cc596d1)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:57.984660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e15fa1-c26c-4d87-aeb4-058d63192d01 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:57.986369 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 79/153] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:11:57 2022] GET /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:57.987879 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7ac72-b2cf-459a-9f06-2ea4b939bb27 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:57.988164 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7ac72-b2cf-459a-9f06-2ea4b939bb27 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:57.988437 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7ac72-b2cf-459a-9f06-2ea4b939bb27 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:57.990024 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 80/154] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:57.999949 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928d292-22d7-477a-a916-d82bff2d2825 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:58.000235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928d292-22d7-477a-a916-d82bff2d2825 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:58.000649 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928d292-22d7-477a-a916-d82bff2d2825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:58.030660 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78ef2d-6764-4f73-b89b-5bb06399d32d None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:58.035753 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-6928d292-22d7-477a-a916-d82bff2d2825 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:58.037328 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6928d292-22d7-477a-a916-d82bff2d2825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:58.073877 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:58.115270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d895a7-22c0-4794-a6a9-579bf0e625ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:58.115922 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d895a7-22c0-4794-a6a9-579bf0e625ec None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:58.116201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d895a7-22c0-4794-a6a9-579bf0e625ec None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:58.116591 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d895a7-22c0-4794-a6a9-579bf0e625ec None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:58.123334 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d895a7-22c0-4794-a6a9-579bf0e625ec None admin] RBAC: Authorizing `identity:get_project(project_id=91bbd1bb0efc40338fac7e525cc596d1)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:58.124825 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d895a7-22c0-4794-a6a9-579bf0e625ec None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:58.126951 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 75/155] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:11:57 2022] GET /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1 => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:58.127818 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d895a7-22c0-4794-a6a9-579bf0e625ec None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:58.188036 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 81/156] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:11:58.188783 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928d292-22d7-477a-a916-d82bff2d2825 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:58.350491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d895a7-22c0-4794-a6a9-579bf0e625ec None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:58.395974 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:58.425372 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928d292-22d7-477a-a916-d82bff2d2825 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:58.431347 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b3a4a-5fa4-4c7d-af34-3c03d515f807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:58.432271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b3a4a-5fa4-4c7d-af34-3c03d515f807 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:58.432591 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b3a4a-5fa4-4c7d-af34-3c03d515f807 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:58.432814 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b3a4a-5fa4-4c7d-af34-3c03d515f807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:58.433547 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b3a4a-5fa4-4c7d-af34-3c03d515f807 None admin] RBAC: Adding query filter params (role.id=83a904d35afc48fe9f8d55c0fd1597d8, scope.project.id=91bbd1bb0efc40338fac7e525cc596d1, user.id=9d563cd2f3b848a3b1b5f14c04761740) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:58.434049 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b3a4a-5fa4-4c7d-af34-3c03d515f807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:58.435312 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b3a4a-5fa4-4c7d-af34-3c03d515f807 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:58.445550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 76/157] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:11:58 2022] GET /identity/v3/role_assignments?user.id=9d563cd2f3b848a3b1b5f14c04761740&scope.project.id=91bbd1bb0efc40338fac7e525cc596d1&role.id=83a904d35afc48fe9f8d55c0fd1597d8 => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:58.446811 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a7421-db3a-47cb-87c6-5db912259308 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:58.447093 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a7421-db3a-47cb-87c6-5db912259308 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:58.447367 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a7421-db3a-47cb-87c6-5db912259308 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:58.449131 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 77/158] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:11:58.454917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0bd18-a289-4cfe-abf3-ee5c31331128 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:58.455192 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0bd18-a289-4cfe-abf3-ee5c31331128 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:58.455470 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0bd18-a289-4cfe-abf3-ee5c31331128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:58.479302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae93a1-838e-49a7-b8a7-b785ad11057d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:58.480128 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae93a1-838e-49a7-b8a7-b785ad11057d None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:58.480409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae93a1-838e-49a7-b8a7-b785ad11057d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:58.480685 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae93a1-838e-49a7-b8a7-b785ad11057d None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1/users/4d432d64e83b4919833ab22be0464f71/roles/14b4522936a24e78a58d9f0dcae537be` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:58.482841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae93a1-838e-49a7-b8a7-b785ad11057d None admin] RBAC: Authorizing `identity:create_grant(project_id=91bbd1bb0efc40338fac7e525cc596d1, user_id=4d432d64e83b4919833ab22be0464f71, role_id=14b4522936a24e78a58d9f0dcae537be)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:58.484296 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae93a1-838e-49a7-b8a7-b785ad11057d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:58.495786 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-33c0bd18-a289-4cfe-abf3-ee5c31331128 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:11:58.497027 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-33c0bd18-a289-4cfe-abf3-ee5c31331128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:11:58.576073 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:58.603794 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 78/159] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:11:58.612803 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 82/160] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Aug 19 19:11:58 2022] PUT /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1/users/4d432d64e83b4919833ab22be0464f71/roles/14b4522936a24e78a58d9f0dcae537be => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:11:58.906215 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0bd18-a289-4cfe-abf3-ee5c31331128 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:59.035177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0bd18-a289-4cfe-abf3-ee5c31331128 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:59.073217 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac67dc-97c1-4d42-aa70-8779753cacdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:59.073854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac67dc-97c1-4d42-aa70-8779753cacdd None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:59.074132 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac67dc-97c1-4d42-aa70-8779753cacdd None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:59.074403 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac67dc-97c1-4d42-aa70-8779753cacdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:59.085830 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac67dc-97c1-4d42-aa70-8779753cacdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:11:59.090722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-d7ac67dc-97c1-4d42-aa70-8779753cacdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:11:59.090722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:11:59.090722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:11:59.090722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:11:59.090722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:11:59.090722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:11:59.090722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:11:59.090722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:11:59.090722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:11:59.090722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:11:59.090722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:11:59.090722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:11:59.090722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:11:59.090722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:11:59.090722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:11:59.090722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:11:59.091577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:11:59.091577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:11:59.091577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:11:59.091577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:11:59.091577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:11:59.091577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:11:59.091577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:11:59.091577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:11:59.091577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:11:59.091577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:11:59.091577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:11:59.091577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:11:59.091577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:11:59.091577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:11:59.091577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:11:59.091577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:11:59.092550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:11:59.092550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:11:59.092550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:11:59.092550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:11:59.092550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:11:59.092550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:11:59.092550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:11:59.092550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:11:59.092550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:11:59.092550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:11:59.092550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:11:59.092550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:11:59.092550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 79/161] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Aug 19 19:11:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:11:59.097808 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae93a1-838e-49a7-b8a7-b785ad11057d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:59.213557 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae93a1-838e-49a7-b8a7-b785ad11057d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:59.256138 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cce01-b6ab-4048-bf77-36705354a0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:59.256770 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cce01-b6ab-4048-bf77-36705354a0eb None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:59.257050 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cce01-b6ab-4048-bf77-36705354a0eb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:59.257324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cce01-b6ab-4048-bf77-36705354a0eb None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:59.258004 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cce01-b6ab-4048-bf77-36705354a0eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:11:59.258306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cce01-b6ab-4048-bf77-36705354a0eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:59.259796 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cce01-b6ab-4048-bf77-36705354a0eb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:59.273764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 83/162] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:11:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:11:59.279595 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac67dc-97c1-4d42-aa70-8779753cacdd None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:59.374904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:59.528171 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cce01-b6ab-4048-bf77-36705354a0eb None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:59.548618 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:11:59.586172 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac67dc-97c1-4d42-aa70-8779753cacdd None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:59.708271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6cd18d-843d-424a-af05-ea6927d310d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:59.709289 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cd18d-843d-424a-af05-ea6927d310d4 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:59.709757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cd18d-843d-424a-af05-ea6927d310d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:59.710215 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cd18d-843d-424a-af05-ea6927d310d4 None admin] PATH_INFO: `/v3/users/7ffe86579b7344d19702549b20bcc927` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:59.711637 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6cd18d-843d-424a-af05-ea6927d310d4 None admin] RBAC: Authorizing `identity:get_user(user_id=7ffe86579b7344d19702549b20bcc927)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:11:59.718859 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6cd18d-843d-424a-af05-ea6927d310d4 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:11:59.720876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 80/163] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:11:59 2022] GET /identity/v3/users/7ffe86579b7344d19702549b20bcc927 => generated 247 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:11:59.731504 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6cd18d-843d-424a-af05-ea6927d310d4 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:59.754778 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cce01-b6ab-4048-bf77-36705354a0eb None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:11:59.851399 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd03f8-0fb4-4b49-a818-aca6ec32bea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:11:59.852307 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd03f8-0fb4-4b49-a818-aca6ec32bea9 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:11:59.852841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd03f8-0fb4-4b49-a818-aca6ec32bea9 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:11:59.853252 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd03f8-0fb4-4b49-a818-aca6ec32bea9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:11:59.881568 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd03f8-0fb4-4b49-a818-aca6ec32bea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:11:59.893438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-1abd03f8-0fb4-4b49-a818-aca6ec32bea9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:11:59.893438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:11:59.893438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:11:59.893438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:11:59.893438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:11:59.893438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:11:59.893438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:11:59.893438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:11:59.893438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:11:59.893438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:11:59.893438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:11:59.893438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:11:59.893438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:11:59.893438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:11:59.893438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:11:59.893438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:11:59.898562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:11:59.898562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:11:59.898562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:11:59.898562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:11:59.898562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:11:59.898562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:11:59.898562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:11:59.898562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:11:59.898562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:11:59.898562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:11:59.898562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:11:59.898562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:11:59.898562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:11:59.898562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:11:59.898562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:11:59.898562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:11:59.899408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:11:59.899408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:11:59.899408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:11:59.899408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:11:59.899408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:11:59.899408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:11:59.899408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:11:59.899408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:11:59.899408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:11:59.899408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:11:59.899408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:11:59.899408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:11:59.899408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 84/164] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:11:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:11:59.902389 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd03f8-0fb4-4b49-a818-aca6ec32bea9 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:11:59.979464 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:00.015992 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd03f8-0fb4-4b49-a818-aca6ec32bea9 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:00.016865 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6cd18d-843d-424a-af05-ea6927d310d4 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:00.044122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:00.054745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd857b-a4df-431a-99ef-ebfd25d63f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:00.067125 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd857b-a4df-431a-99ef-ebfd25d63f80 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:00.067125 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd857b-a4df-431a-99ef-ebfd25d63f80 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:00.067125 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd857b-a4df-431a-99ef-ebfd25d63f80 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:00.067125 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd857b-a4df-431a-99ef-ebfd25d63f80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:00.067125 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd857b-a4df-431a-99ef-ebfd25d63f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:00.067125 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd857b-a4df-431a-99ef-ebfd25d63f80 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:00.067554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 85/165] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:11:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:00.068758 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff444386-41be-4c23-a7fd-1e5ef5633309 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:00.069198 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff444386-41be-4c23-a7fd-1e5ef5633309 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:00.069619 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff444386-41be-4c23-a7fd-1e5ef5633309 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:00.070999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 86/166] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:00.082633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff444386-41be-4c23-a7fd-1e5ef5633309 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:00.107314 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3c417-ea8f-4e67-b51f-38bcd15a7c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:00.107898 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3c417-ea8f-4e67-b51f-38bcd15a7c43 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:00.108174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3c417-ea8f-4e67-b51f-38bcd15a7c43 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:00.108436 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3c417-ea8f-4e67-b51f-38bcd15a7c43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:00.284551 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3c417-ea8f-4e67-b51f-38bcd15a7c43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:00.286096 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3c417-ea8f-4e67-b51f-38bcd15a7c43 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:00.343987 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff444386-41be-4c23-a7fd-1e5ef5633309 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:00.398861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:00.412248 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa58936-c1cf-46e4-b5e8-04f5af6ffd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:00.416034 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa58936-c1cf-46e4-b5e8-04f5af6ffd29 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:00.416034 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa58936-c1cf-46e4-b5e8-04f5af6ffd29 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:00.416034 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa58936-c1cf-46e4-b5e8-04f5af6ffd29 None admin] PATH_INFO: `/v3/users/9d563cd2f3b848a3b1b5f14c04761740` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:00.416034 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa58936-c1cf-46e4-b5e8-04f5af6ffd29 None admin] RBAC: Authorizing `identity:get_user(user_id=9d563cd2f3b848a3b1b5f14c04761740)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:00.418012 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa58936-c1cf-46e4-b5e8-04f5af6ffd29 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:00.419974 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 87/167] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:00 2022] GET /identity/v3/users/9d563cd2f3b848a3b1b5f14c04761740 => generated 275 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:00.421344 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd8fd7-4d40-4825-8693-5a2658c0d0df None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:00.421628 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd8fd7-4d40-4825-8693-5a2658c0d0df None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:00.422244 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd8fd7-4d40-4825-8693-5a2658c0d0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:00.464980 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-60dd8fd7-4d40-4825-8693-5a2658c0d0df None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:00.466220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-60dd8fd7-4d40-4825-8693-5a2658c0d0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:00.541726 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 81/168] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:11:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 810 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:00.542622 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3c417-ea8f-4e67-b51f-38bcd15a7c43 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:00.577638 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:00.595493 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 88/169] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:00.596485 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd8fd7-4d40-4825-8693-5a2658c0d0df None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:00.764878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3c417-ea8f-4e67-b51f-38bcd15a7c43 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:00.832402 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c21ca6-3e66-4378-ba97-0a1e855781df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:00.833031 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c21ca6-3e66-4378-ba97-0a1e855781df None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:00.833310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c21ca6-3e66-4378-ba97-0a1e855781df None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:00.833574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c21ca6-3e66-4378-ba97-0a1e855781df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:00.857088 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd8fd7-4d40-4825-8693-5a2658c0d0df None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:00.923460 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c21ca6-3e66-4378-ba97-0a1e855781df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:00.924942 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c21ca6-3e66-4378-ba97-0a1e855781df None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:00.942872 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:00.944538 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:00.971256 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f7855-3702-453d-acb9-ddc4eff6fce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:00.971915 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f7855-3702-453d-acb9-ddc4eff6fce0 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:00.972195 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f7855-3702-453d-acb9-ddc4eff6fce0 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:00.972467 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f7855-3702-453d-acb9-ddc4eff6fce0 None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:00.973730 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f7855-3702-453d-acb9-ddc4eff6fce0 None admin] RBAC: Authorizing `identity:get_project(project_id=91bbd1bb0efc40338fac7e525cc596d1)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:00.975217 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f7855-3702-453d-acb9-ddc4eff6fce0 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:00.976871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 89/170] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:00 2022] GET /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1 => generated 298 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:00.983926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f7855-3702-453d-acb9-ddc4eff6fce0 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:01.057525 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 82/171] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:01.064833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c21ca6-3e66-4378-ba97-0a1e855781df None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:01.177920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c21ca6-3e66-4378-ba97-0a1e855781df None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:01.179374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f7855-3702-453d-acb9-ddc4eff6fce0 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:01.193129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:01.221018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79087029-d006-4199-8b85-44f71be622aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:01.221946 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79087029-d006-4199-8b85-44f71be622aa None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:01.222389 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79087029-d006-4199-8b85-44f71be622aa None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:01.222890 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79087029-d006-4199-8b85-44f71be622aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:01.223771 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79087029-d006-4199-8b85-44f71be622aa None admin] RBAC: Adding query filter params (role.id=8fdfbc4aaf68468f89a5ae3450b8488d, scope.project.id=91bbd1bb0efc40338fac7e525cc596d1, user.id=7ffe86579b7344d19702549b20bcc927) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:01.224241 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79087029-d006-4199-8b85-44f71be622aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:01.224788 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a22951-52b6-4b1b-86b3-0c1c5b5bcd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:01.225520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a22951-52b6-4b1b-86b3-0c1c5b5bcd3c None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:01.225807 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a22951-52b6-4b1b-86b3-0c1c5b5bcd3c None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:01.226083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a22951-52b6-4b1b-86b3-0c1c5b5bcd3c None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:01.226729 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79087029-d006-4199-8b85-44f71be622aa None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:01.227249 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a22951-52b6-4b1b-86b3-0c1c5b5bcd3c None admin] RBAC: Authorizing `identity:get_project(project_id=91bbd1bb0efc40338fac7e525cc596d1)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:01.229556 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a22951-52b6-4b1b-86b3-0c1c5b5bcd3c None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:01.232142 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 83/172] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:01 2022] GET /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:01.233953 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b06857-e7c2-453d-9477-69d7c10c9385 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:01.234422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b06857-e7c2-453d-9477-69d7c10c9385 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:01.234887 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b06857-e7c2-453d-9477-69d7c10c9385 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:01.235390 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 90/173] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:12:00 2022] GET /identity/v3/role_assignments?user.id=7ffe86579b7344d19702549b20bcc927&scope.project.id=91bbd1bb0efc40338fac7e525cc596d1&role.id=8fdfbc4aaf68468f89a5ae3450b8488d => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:01.237015 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c91aad-f8c5-421a-8245-f8cd9fa53039 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:01.237747 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c91aad-f8c5-421a-8245-f8cd9fa53039 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:01.238213 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c91aad-f8c5-421a-8245-f8cd9fa53039 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:01.240131 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 91/174] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:01.241166 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c91aad-f8c5-421a-8245-f8cd9fa53039 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:01.242965 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 84/175] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:01.244149 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b06857-e7c2-453d-9477-69d7c10c9385 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:01.395204 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b06857-e7c2-453d-9477-69d7c10c9385 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:01.417994 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:01.438505 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520ecb9-11aa-4601-b0d8-045bfbbc5fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:01.439452 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520ecb9-11aa-4601-b0d8-045bfbbc5fff None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:01.439872 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520ecb9-11aa-4601-b0d8-045bfbbc5fff None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:01.440287 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520ecb9-11aa-4601-b0d8-045bfbbc5fff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:01.441525 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520ecb9-11aa-4601-b0d8-045bfbbc5fff None admin] RBAC: Adding query filter params (role.id=097319c04e61414e80385247dbf5003a, scope.project.id=91bbd1bb0efc40338fac7e525cc596d1, user.id=9d563cd2f3b848a3b1b5f14c04761740) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:01.442087 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520ecb9-11aa-4601-b0d8-045bfbbc5fff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:01.443882 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520ecb9-11aa-4601-b0d8-045bfbbc5fff None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:01.451701 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 85/176] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:12:01 2022] GET /identity/v3/role_assignments?user.id=9d563cd2f3b848a3b1b5f14c04761740&scope.project.id=91bbd1bb0efc40338fac7e525cc596d1&role.id=097319c04e61414e80385247dbf5003a => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:01.453240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc7194-c190-4373-a7cc-22e34c871f79 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:01.453783 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc7194-c190-4373-a7cc-22e34c871f79 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:01.454196 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc7194-c190-4373-a7cc-22e34c871f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:01.468865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c91aad-f8c5-421a-8245-f8cd9fa53039 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:01.477760 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-33fc7194-c190-4373-a7cc-22e34c871f79 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:01.479899 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-33fc7194-c190-4373-a7cc-22e34c871f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:01.519454 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2060c71-d37e-4e36-b5fd-b327e8260c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:01.520187 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2060c71-d37e-4e36-b5fd-b327e8260c83 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:01.520467 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2060c71-d37e-4e36-b5fd-b327e8260c83 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:01.520737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2060c71-d37e-4e36-b5fd-b327e8260c83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:01.530435 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:01.539270 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2060c71-d37e-4e36-b5fd-b327e8260c83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:01.546660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-d2060c71-d37e-4e36-b5fd-b327e8260c83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:01.546660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:01.546660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:01.546660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:01.546660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:01.546660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:01.546660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:01.546660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:01.546660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:01.546660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:01.546660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:01.546660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:01.546660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:01.546660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:01.546660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:01.546660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:01.547530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:01.547530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:01.547530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:01.547530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:01.547530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:01.547530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:01.547530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:01.547530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:01.547530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:01.547530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:01.547530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:01.547530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:01.547530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:01.547530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:01.547530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:01.547530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:01.548308 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:01.548308 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:01.548308 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:01.548308 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:01.548308 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:01.548308 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:01.548308 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:01.548308 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:01.548308 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:01.548308 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:01.548308 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:01.548308 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:01.550660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 92/177] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:01.553881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18170f0f-a529-4065-b7f7-0ace43188231 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:01.554491 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18170f0f-a529-4065-b7f7-0ace43188231 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:01.555018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18170f0f-a529-4065-b7f7-0ace43188231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:01.585080 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-18170f0f-a529-4065-b7f7-0ace43188231 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:01.586300 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-18170f0f-a529-4065-b7f7-0ace43188231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:01.587026 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 86/178] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:01.589472 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba2dcd-87f9-4543-8391-f4e593b0ccb9 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:01.590087 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba2dcd-87f9-4543-8391-f4e593b0ccb9 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:01.590570 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba2dcd-87f9-4543-8391-f4e593b0ccb9 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:01.592341 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 87/179] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:01.593201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba2dcd-87f9-4543-8391-f4e593b0ccb9 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:01.683855 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 93/180] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:01.685584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde50158-0071-4bdd-aa6d-d419e50ed2c1 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:01.686065 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde50158-0071-4bdd-aa6d-d419e50ed2c1 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:01.686551 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde50158-0071-4bdd-aa6d-d419e50ed2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:01.719181 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba2dcd-87f9-4543-8391-f4e593b0ccb9 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:01.719660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-fde50158-0071-4bdd-aa6d-d419e50ed2c1 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:01.720883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-fde50158-0071-4bdd-aa6d-d419e50ed2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:01.761225 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3eb51-5a3d-48be-9641-9c28da096331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:01.762364 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3eb51-5a3d-48be-9641-9c28da096331 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:01.762931 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3eb51-5a3d-48be-9641-9c28da096331 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:01.763487 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3eb51-5a3d-48be-9641-9c28da096331 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:01.764360 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3eb51-5a3d-48be-9641-9c28da096331 None admin] RBAC: Adding query filter params (name=member) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:01.764892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3eb51-5a3d-48be-9641-9c28da096331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:01.766559 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3eb51-5a3d-48be-9641-9c28da096331 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:01.776637 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 88/181] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:01.783413 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:01.785444 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3eb51-5a3d-48be-9641-9c28da096331 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:01.824852 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:01.840497 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 94/182] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:01.895635 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3eb51-5a3d-48be-9641-9c28da096331 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:01.932015 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b9eb8-3090-4bd1-974a-1a76bf9dcd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:01.933064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b9eb8-3090-4bd1-974a-1a76bf9dcd94 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:01.933540 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b9eb8-3090-4bd1-974a-1a76bf9dcd94 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:01.934055 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b9eb8-3090-4bd1-974a-1a76bf9dcd94 None admin] PATH_INFO: `/v3/users/9d563cd2f3b848a3b1b5f14c04761740` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:01.935430 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b9eb8-3090-4bd1-974a-1a76bf9dcd94 None admin] RBAC: Authorizing `identity:get_user(user_id=9d563cd2f3b848a3b1b5f14c04761740)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:01.937084 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b9eb8-3090-4bd1-974a-1a76bf9dcd94 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:01.939075 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 89/183] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:01 2022] GET /identity/v3/users/9d563cd2f3b848a3b1b5f14c04761740 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:01.945410 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde50158-0071-4bdd-aa6d-d419e50ed2c1 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:02.087079 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b9eb8-3090-4bd1-974a-1a76bf9dcd94 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:02.092493 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde50158-0071-4bdd-aa6d-d419e50ed2c1 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:02.139508 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcd711-aec3-49b9-8c59-ffe4c5318c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:02.140123 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcd711-aec3-49b9-8c59-ffe4c5318c68 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:02.140397 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcd711-aec3-49b9-8c59-ffe4c5318c68 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:02.140667 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcd711-aec3-49b9-8c59-ffe4c5318c68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:02.234354 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:02.257921 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdcd711-aec3-49b9-8c59-ffe4c5318c68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:02.259339 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b9eb8-3090-4bd1-974a-1a76bf9dcd94 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:02.259656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdcd711-aec3-49b9-8c59-ffe4c5318c68 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:02.261481 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:02.302922 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d121d-4681-45cd-983d-28e76799d396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:02.303554 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d121d-4681-45cd-983d-28e76799d396 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:02.303832 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d121d-4681-45cd-983d-28e76799d396 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:02.304098 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d121d-4681-45cd-983d-28e76799d396 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:02.317785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d121d-4681-45cd-983d-28e76799d396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:02.323641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-cc3d121d-4681-45cd-983d-28e76799d396 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:12:02.323641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:02.323641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:02.323641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:02.323641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:02.323641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:02.323641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:02.323641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:02.323641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:02.323641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:02.323641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:02.323641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:02.323641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:02.323641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:02.323641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:02.323641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:02.327117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:02.327117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:02.327117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:02.327117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:02.327117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:02.327117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:02.327117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:02.327117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:02.327117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:02.327117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:02.327117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:02.327117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:02.327117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:02.327117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:02.327117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:02.327117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:02.327885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:02.327885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:02.327885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:02.327885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:02.327885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:02.327885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:02.327885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:02.327885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:02.327885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:02.327885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:02.327885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:12:02.327885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:02.327885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 90/184] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Aug 19 19:12:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:12:02.327885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d121d-4681-45cd-983d-28e76799d396 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:02.377560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 95/185] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:02.377560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcd711-aec3-49b9-8c59-ffe4c5318c68 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:02.442544 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d121d-4681-45cd-983d-28e76799d396 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:02.461206 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:02.476456 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1d8c4-1d4b-4229-b623-9f06322eb1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:02.477083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1d8c4-1d4b-4229-b623-9f06322eb1f3 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:02.477358 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1d8c4-1d4b-4229-b623-9f06322eb1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:02.477620 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1d8c4-1d4b-4229-b623-9f06322eb1f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:02.479867 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcd711-aec3-49b9-8c59-ffe4c5318c68 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:02.487765 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1d8c4-1d4b-4229-b623-9f06322eb1f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:02.492762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-88b1d8c4-1d4b-4229-b623-9f06322eb1f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:12:02.492762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:02.492762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:02.492762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:02.492762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:02.492762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:02.492762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:02.492762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:02.492762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:02.492762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:02.492762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:02.492762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:02.492762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:02.492762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:02.492762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:02.492762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:02.493653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:02.493653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:02.493653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:02.493653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:02.493653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:02.493653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:02.493653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:02.493653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:02.493653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:02.493653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:02.493653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:02.493653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:02.493653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:02.493653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:02.493653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:02.493653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:02.495550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:02.495550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:02.495550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:02.495550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:02.495550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:02.495550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:02.495550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:02.495550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:02.495550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:02.495550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:02.495550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:12:02.495550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:02.495550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 91/186] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:12:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:02.499375 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1d8c4-1d4b-4229-b623-9f06322eb1f3 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:02.515942 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066e574-006f-4d68-b286-50a8c42f4494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:02.516574 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066e574-006f-4d68-b286-50a8c42f4494 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:02.516839 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066e574-006f-4d68-b286-50a8c42f4494 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:02.517103 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066e574-006f-4d68-b286-50a8c42f4494 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:02.518192 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066e574-006f-4d68-b286-50a8c42f4494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:02.519671 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066e574-006f-4d68-b286-50a8c42f4494 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:02.522187 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 96/187] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:02.522187 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066e574-006f-4d68-b286-50a8c42f4494 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:02.524343 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:02.606618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1d8c4-1d4b-4229-b623-9f06322eb1f3 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:02.623980 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066e574-006f-4d68-b286-50a8c42f4494 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:02.640310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01742bc-4d7a-4973-b372-00c70b314cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:02.640914 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01742bc-4d7a-4973-b372-00c70b314cc4 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:02.641191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01742bc-4d7a-4973-b372-00c70b314cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:02.641464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01742bc-4d7a-4973-b372-00c70b314cc4 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:02.642123 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01742bc-4d7a-4973-b372-00c70b314cc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:02.642422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01742bc-4d7a-4973-b372-00c70b314cc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:02.643852 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01742bc-4d7a-4973-b372-00c70b314cc4 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:02.651844 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 92/188] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:02.655865 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71260f43-0b58-4744-8015-671371c0a54e None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:02.656154 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71260f43-0b58-4744-8015-671371c0a54e None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:02.656409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71260f43-0b58-4744-8015-671371c0a54e None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:02.657654 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 93/189] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:02.658671 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fd708-0315-491f-98e1-ba0ee7ca84ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:02.658671 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fd708-0315-491f-98e1-ba0ee7ca84ce None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:02.658979 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71260f43-0b58-4744-8015-671371c0a54e None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:02.659056 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fd708-0315-491f-98e1-ba0ee7ca84ce None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:02.659056 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fd708-0315-491f-98e1-ba0ee7ca84ce None admin] PATH_INFO: `/v3/projects/1d5d855878374541a719cd30fd1b583b` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:02.662250 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fd708-0315-491f-98e1-ba0ee7ca84ce None admin] RBAC: Authorizing `identity:get_project(project_id=1d5d855878374541a719cd30fd1b583b)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:02.663723 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fd708-0315-491f-98e1-ba0ee7ca84ce None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:02.665339 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 97/190] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:02 2022] GET /identity/v3/projects/1d5d855878374541a719cd30fd1b583b => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:02.666075 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fd708-0315-491f-98e1-ba0ee7ca84ce None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:02.687239 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:02.746692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:02.763513 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71260f43-0b58-4744-8015-671371c0a54e None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:02.768780 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fd708-0315-491f-98e1-ba0ee7ca84ce None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:02.797282 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f08c6-b1e6-490b-91ac-e14832058a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:02.797892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f08c6-b1e6-490b-91ac-e14832058a62 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:02.798161 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f08c6-b1e6-490b-91ac-e14832058a62 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:02.798430 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f08c6-b1e6-490b-91ac-e14832058a62 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:02.799120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f08c6-b1e6-490b-91ac-e14832058a62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:02.799421 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f08c6-b1e6-490b-91ac-e14832058a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:02.800779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f08c6-b1e6-490b-91ac-e14832058a62 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:02.803039 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bc5de-251a-4516-8375-5b3c8ce9fd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:02.803632 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bc5de-251a-4516-8375-5b3c8ce9fd1a None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:02.803901 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bc5de-251a-4516-8375-5b3c8ce9fd1a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:02.804164 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bc5de-251a-4516-8375-5b3c8ce9fd1a None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:02.804790 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bc5de-251a-4516-8375-5b3c8ce9fd1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:02.806210 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bc5de-251a-4516-8375-5b3c8ce9fd1a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:02.809007 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 94/191] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:12:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:02.809793 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f08c6-b1e6-490b-91ac-e14832058a62 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:02.888986 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 98/192] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Aug 19 19:12:02 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:12:02.890332 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614f7e7-d0ec-4b4e-8acb-64fff5feb770 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:02.890660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614f7e7-d0ec-4b4e-8acb-64fff5feb770 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:02.890933 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614f7e7-d0ec-4b4e-8acb-64fff5feb770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:02.913708 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f08c6-b1e6-490b-91ac-e14832058a62 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:02.915962 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-e614f7e7-d0ec-4b4e-8acb-64fff5feb770 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:02.917553 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e614f7e7-d0ec-4b4e-8acb-64fff5feb770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:02.955240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15e1a0-fbf7-4d0a-811f-1f455bd1c2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:02.956342 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15e1a0-fbf7-4d0a-811f-1f455bd1c2a1 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:02.956832 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15e1a0-fbf7-4d0a-811f-1f455bd1c2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:02.957415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15e1a0-fbf7-4d0a-811f-1f455bd1c2a1 None admin] PATH_INFO: `/v3/users/19d53e234aa1459a9113d8673ad6fb31` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:02.975175 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15e1a0-fbf7-4d0a-811f-1f455bd1c2a1 None admin] RBAC: Authorizing `identity:get_user(user_id=19d53e234aa1459a9113d8673ad6fb31)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:02.977069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15e1a0-fbf7-4d0a-811f-1f455bd1c2a1 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:02.979415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 95/193] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:02 2022] GET /identity/v3/users/19d53e234aa1459a9113d8673ad6fb31 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:02.985330 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15e1a0-fbf7-4d0a-811f-1f455bd1c2a1 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:02.989686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:02.993612 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 99/194] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:02.994740 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614f7e7-d0ec-4b4e-8acb-64fff5feb770 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:02.997311 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:03.106270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15e1a0-fbf7-4d0a-811f-1f455bd1c2a1 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:03.139695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614f7e7-d0ec-4b4e-8acb-64fff5feb770 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:03.152614 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9840a8-0bfc-46fc-a6f2-530ee59a82d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:03.153235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9840a8-0bfc-46fc-a6f2-530ee59a82d3 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:03.153813 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9840a8-0bfc-46fc-a6f2-530ee59a82d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:03.154090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9840a8-0bfc-46fc-a6f2-530ee59a82d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:03.155281 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9840a8-0bfc-46fc-a6f2-530ee59a82d3 None admin] RBAC: Adding query filter params (role.id=83a904d35afc48fe9f8d55c0fd1597d8, scope.project.id=1d5d855878374541a719cd30fd1b583b, user.id=9d563cd2f3b848a3b1b5f14c04761740) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:03.155383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9840a8-0bfc-46fc-a6f2-530ee59a82d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:03.156990 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9840a8-0bfc-46fc-a6f2-530ee59a82d3 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:03.163126 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 96/195] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:12:02 2022] GET /identity/v3/role_assignments?user.id=9d563cd2f3b848a3b1b5f14c04761740&scope.project.id=1d5d855878374541a719cd30fd1b583b&role.id=83a904d35afc48fe9f8d55c0fd1597d8 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:03.163754 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9840a8-0bfc-46fc-a6f2-530ee59a82d3 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:03.182932 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa404b-8004-4881-b63d-bed1fb96b631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:03.183845 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa404b-8004-4881-b63d-bed1fb96b631 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:03.184186 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa404b-8004-4881-b63d-bed1fb96b631 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:03.184533 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa404b-8004-4881-b63d-bed1fb96b631 None admin] PATH_INFO: `/v3/users/19d53e234aa1459a9113d8673ad6fb31` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:03.185907 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa404b-8004-4881-b63d-bed1fb96b631 None admin] RBAC: Authorizing `identity:get_user(user_id=19d53e234aa1459a9113d8673ad6fb31)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:03.187559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa404b-8004-4881-b63d-bed1fb96b631 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:03.190297 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 100/196] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:02 2022] GET /identity/v3/users/19d53e234aa1459a9113d8673ad6fb31 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:03.195805 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa404b-8004-4881-b63d-bed1fb96b631 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:03.258706 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:03.296081 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:03.312346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9840a8-0bfc-46fc-a6f2-530ee59a82d3 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:03.381267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa404b-8004-4881-b63d-bed1fb96b631 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:03.390425 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c06f0c-448e-4231-9cb1-eaa0456f50de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:03.390718 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c06f0c-448e-4231-9cb1-eaa0456f50de None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:03.390907 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c06f0c-448e-4231-9cb1-eaa0456f50de None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:03.391176 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c06f0c-448e-4231-9cb1-eaa0456f50de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:03.425565 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5c743-c44d-4336-8b6e-08cb2ea9364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:03.426247 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5c743-c44d-4336-8b6e-08cb2ea9364f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:03.426729 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5c743-c44d-4336-8b6e-08cb2ea9364f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:03.427003 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5c743-c44d-4336-8b6e-08cb2ea9364f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:03.477094 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c06f0c-448e-4231-9cb1-eaa0456f50de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:03.478623 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c06f0c-448e-4231-9cb1-eaa0456f50de None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:03.531098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5c743-c44d-4336-8b6e-08cb2ea9364f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:03.536023 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5c743-c44d-4336-8b6e-08cb2ea9364f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:03.581818 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:03.627802 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:03.630415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 97/197] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:03.631581 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c06f0c-448e-4231-9cb1-eaa0456f50de None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:03.678787 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 101/198] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:03.678787 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5c743-c44d-4336-8b6e-08cb2ea9364f None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:03.764596 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c06f0c-448e-4231-9cb1-eaa0456f50de None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:03.791855 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5c743-c44d-4336-8b6e-08cb2ea9364f None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:03.804655 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdcf77-68f1-4cd6-85da-d52e053c18e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:03.805352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdcf77-68f1-4cd6-85da-d52e053c18e2 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:03.805563 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdcf77-68f1-4cd6-85da-d52e053c18e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:03.805833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdcf77-68f1-4cd6-85da-d52e053c18e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:03.819438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdcf77-68f1-4cd6-85da-d52e053c18e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:03.824897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-c6fdcf77-68f1-4cd6-85da-d52e053c18e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:12:03.824897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:03.824897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:03.824897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:03.824897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:03.824897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:03.824897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:03.824897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:03.824897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:03.824897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:03.824897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:03.824897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:03.824897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:03.824897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:03.824897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:03.824897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:03.825771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:03.825771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:03.825771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:03.825771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:03.825771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:03.825771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:03.825771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:03.825771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:03.825771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:03.825771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:03.825771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:03.825771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:03.825771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:03.825771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:03.825771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:03.825771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:03.826595 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:03.826595 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:03.826595 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:03.826595 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:03.826595 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:03.826595 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:03.826595 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:03.826595 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:03.826595 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:03.826595 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:03.826595 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:12:03.826595 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:03.827211 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 98/199] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:03.827745 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdcf77-68f1-4cd6-85da-d52e053c18e2 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:03.835461 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dec914-efec-4c20-8071-f7b11b5d015f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:03.836360 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dec914-efec-4c20-8071-f7b11b5d015f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:03.836833 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dec914-efec-4c20-8071-f7b11b5d015f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:03.837299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dec914-efec-4c20-8071-f7b11b5d015f None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:03.839279 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dec914-efec-4c20-8071-f7b11b5d015f None admin] RBAC: Authorizing `identity:get_project(project_id=35715c28855e4d0b93c644f5a3804760)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:03.841269 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dec914-efec-4c20-8071-f7b11b5d015f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:03.844494 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 102/200] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:03 2022] GET /identity/v3/projects/35715c28855e4d0b93c644f5a3804760 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:03.845958 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dec914-efec-4c20-8071-f7b11b5d015f None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:03.863979 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:03.903063 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:03.953334 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdcf77-68f1-4cd6-85da-d52e053c18e2 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:03.974022 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dec914-efec-4c20-8071-f7b11b5d015f None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:03.991335 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a518f65-3475-4a9d-aa74-0c68e0ef193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:03.992052 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a518f65-3475-4a9d-aa74-0c68e0ef193e None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:03.992397 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a518f65-3475-4a9d-aa74-0c68e0ef193e None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:03.992736 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a518f65-3475-4a9d-aa74-0c68e0ef193e None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:03.993961 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a518f65-3475-4a9d-aa74-0c68e0ef193e None admin] RBAC: Authorizing `identity:get_project(project_id=35715c28855e4d0b93c644f5a3804760)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:03.996353 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a518f65-3475-4a9d-aa74-0c68e0ef193e None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:04.002605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 99/201] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:03 2022] GET /identity/v3/projects/35715c28855e4d0b93c644f5a3804760 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:04.002605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a518f65-3475-4a9d-aa74-0c68e0ef193e None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:04.026779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6572ee-3d5a-4dea-8c63-164f82a43286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:04.028036 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6572ee-3d5a-4dea-8c63-164f82a43286 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:04.028511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6572ee-3d5a-4dea-8c63-164f82a43286 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:04.029177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6572ee-3d5a-4dea-8c63-164f82a43286 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:04.030501 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6572ee-3d5a-4dea-8c63-164f82a43286 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:04.031357 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6572ee-3d5a-4dea-8c63-164f82a43286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:04.033641 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6572ee-3d5a-4dea-8c63-164f82a43286 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:04.045769 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 103/202] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:04.046824 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6572ee-3d5a-4dea-8c63-164f82a43286 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:04.108929 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:04.115271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a518f65-3475-4a9d-aa74-0c68e0ef193e None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:04.153553 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18976388-3a11-4c42-8025-96b6efb09b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:04.154385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18976388-3a11-4c42-8025-96b6efb09b6f None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:04.155114 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18976388-3a11-4c42-8025-96b6efb09b6f None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:04.155530 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18976388-3a11-4c42-8025-96b6efb09b6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:04.156866 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18976388-3a11-4c42-8025-96b6efb09b6f None admin] RBAC: Adding query filter params (role.id=8fdfbc4aaf68468f89a5ae3450b8488d, scope.project.id=35715c28855e4d0b93c644f5a3804760, user.id=19d53e234aa1459a9113d8673ad6fb31) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:04.157609 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18976388-3a11-4c42-8025-96b6efb09b6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:04.159852 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18976388-3a11-4c42-8025-96b6efb09b6f None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:04.167160 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 100/203] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:12:03 2022] GET /identity/v3/role_assignments?user.id=19d53e234aa1459a9113d8673ad6fb31&scope.project.id=35715c28855e4d0b93c644f5a3804760&role.id=8fdfbc4aaf68468f89a5ae3450b8488d => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:04.168542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18976388-3a11-4c42-8025-96b6efb09b6f None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:04.173925 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:04.177690 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6572ee-3d5a-4dea-8c63-164f82a43286 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:04.225354 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030806cc-503f-404a-89f9-b045f2eba437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:04.226249 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030806cc-503f-404a-89f9-b045f2eba437 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:04.226735 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030806cc-503f-404a-89f9-b045f2eba437 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:04.227860 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030806cc-503f-404a-89f9-b045f2eba437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:04.229314 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030806cc-503f-404a-89f9-b045f2eba437 None admin] RBAC: Adding query filter params (role.id=097319c04e61414e80385247dbf5003a, scope.project.id=35715c28855e4d0b93c644f5a3804760, user.id=19d53e234aa1459a9113d8673ad6fb31) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:04.229770 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030806cc-503f-404a-89f9-b045f2eba437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:04.231900 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030806cc-503f-404a-89f9-b045f2eba437 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:04.240578 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 104/204] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:12:04 2022] GET /identity/v3/role_assignments?user.id=19d53e234aa1459a9113d8673ad6fb31&scope.project.id=35715c28855e4d0b93c644f5a3804760&role.id=097319c04e61414e80385247dbf5003a => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:04.304539 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18976388-3a11-4c42-8025-96b6efb09b6f None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:04.351281 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c56a35-73ef-4836-afcf-b30eee011656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:04.351950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c56a35-73ef-4836-afcf-b30eee011656 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:04.352228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c56a35-73ef-4836-afcf-b30eee011656 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:04.352498 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c56a35-73ef-4836-afcf-b30eee011656 None admin] PATH_INFO: `/v3/users/4d432d64e83b4919833ab22be0464f71` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:04.355217 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c56a35-73ef-4836-afcf-b30eee011656 None admin] RBAC: Authorizing `identity:get_user(user_id=4d432d64e83b4919833ab22be0464f71)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:04.357066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c56a35-73ef-4836-afcf-b30eee011656 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:04.359083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 101/205] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:04 2022] GET /identity/v3/users/4d432d64e83b4919833ab22be0464f71 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:04.365125 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030806cc-503f-404a-89f9-b045f2eba437 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:04.520380 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030806cc-503f-404a-89f9-b045f2eba437 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:04.560922 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237be9c0-6f80-4aee-a135-bb7de621de31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:04.561641 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237be9c0-6f80-4aee-a135-bb7de621de31 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:04.561804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237be9c0-6f80-4aee-a135-bb7de621de31 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:04.562079 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237be9c0-6f80-4aee-a135-bb7de621de31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:04.596721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:04.635994 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237be9c0-6f80-4aee-a135-bb7de621de31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:04.637619 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237be9c0-6f80-4aee-a135-bb7de621de31 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:04.741986 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 105/206] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:04.747534 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c56a35-73ef-4836-afcf-b30eee011656 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:04.797983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:04.908799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c56a35-73ef-4836-afcf-b30eee011656 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:04.959480 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e13795-c0c3-4849-9249-d1f986099c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:04.960161 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e13795-c0c3-4849-9249-d1f986099c56 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:04.960443 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e13795-c0c3-4849-9249-d1f986099c56 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:04.960713 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e13795-c0c3-4849-9249-d1f986099c56 None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:04.961847 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e13795-c0c3-4849-9249-d1f986099c56 None admin] RBAC: Authorizing `identity:get_project(project_id=91bbd1bb0efc40338fac7e525cc596d1)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:04.963856 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e13795-c0c3-4849-9249-d1f986099c56 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:04.965786 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 102/207] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:04 2022] GET /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:04.971637 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237be9c0-6f80-4aee-a135-bb7de621de31 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:05.063362 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:05.101785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237be9c0-6f80-4aee-a135-bb7de621de31 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:05.138615 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbc80b-ad1b-43df-93e9-29e69d6545cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:05.139574 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbc80b-ad1b-43df-93e9-29e69d6545cd None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:05.140067 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbc80b-ad1b-43df-93e9-29e69d6545cd None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:05.140526 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbc80b-ad1b-43df-93e9-29e69d6545cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:05.141454 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbc80b-ad1b-43df-93e9-29e69d6545cd None admin] RBAC: Adding query filter params (role.id=14b4522936a24e78a58d9f0dcae537be, scope.project.id=91bbd1bb0efc40338fac7e525cc596d1, user.id=4d432d64e83b4919833ab22be0464f71) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:05.141964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbc80b-ad1b-43df-93e9-29e69d6545cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:05.143634 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbc80b-ad1b-43df-93e9-29e69d6545cd None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:05.149992 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 106/208] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:12:04 2022] GET /identity/v3/role_assignments?user.id=4d432d64e83b4919833ab22be0464f71&scope.project.id=91bbd1bb0efc40338fac7e525cc596d1&role.id=14b4522936a24e78a58d9f0dcae537be => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:05.634620 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b7d78-9616-4506-8386-b6c89f8c9803 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:05.635272 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b7d78-9616-4506-8386-b6c89f8c9803 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:05.635535 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b7d78-9616-4506-8386-b6c89f8c9803 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:05.637097 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 103/209] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:05.642390 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d9784-9852-4023-9b9a-b4e13f9ce821 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:05.643266 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d9784-9852-4023-9b9a-b4e13f9ce821 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:05.643750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d9784-9852-4023-9b9a-b4e13f9ce821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:05.666961 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-902d9784-9852-4023-9b9a-b4e13f9ce821 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:05.668174 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-902d9784-9852-4023-9b9a-b4e13f9ce821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:05.701053 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f2dad-1bfc-48e4-a602-5057a9135b75 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:05.701634 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f2dad-1bfc-48e4-a602-5057a9135b75 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:05.702151 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f2dad-1bfc-48e4-a602-5057a9135b75 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:05.703651 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 104/210] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:05.708892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73e505-28af-4abb-8f33-7ea6042bf983 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:05.709167 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73e505-28af-4abb-8f33-7ea6042bf983 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:05.709435 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73e505-28af-4abb-8f33-7ea6042bf983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:05.732605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-1d73e505-28af-4abb-8f33-7ea6042bf983 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:05.733797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-1d73e505-28af-4abb-8f33-7ea6042bf983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:05.756604 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 107/211] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:05.819456 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 105/212] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:12:06.110921 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d9784-9852-4023-9b9a-b4e13f9ce821 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:06.158789 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73e505-28af-4abb-8f33-7ea6042bf983 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:06.173968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:06.187542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:06.223309 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d9784-9852-4023-9b9a-b4e13f9ce821 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:06.263281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc99c80-5ab2-4bee-9d6b-04084b237660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:06.264173 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc99c80-5ab2-4bee-9d6b-04084b237660 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:06.264623 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc99c80-5ab2-4bee-9d6b-04084b237660 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:06.265036 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc99c80-5ab2-4bee-9d6b-04084b237660 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:06.275479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73e505-28af-4abb-8f33-7ea6042bf983 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:06.276188 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc99c80-5ab2-4bee-9d6b-04084b237660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:06.281041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-0bc99c80-5ab2-4bee-9d6b-04084b237660 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:06.281041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:06.281041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:06.281041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:06.281041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:06.281041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:06.281041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:06.281041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:06.281041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:06.281041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:06.281041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:06.281041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:06.281041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:06.281041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:06.281041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:06.281041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:06.281999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:06.281999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:06.281999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:06.281999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:06.281999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:06.281999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:06.281999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:06.281999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:06.281999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:06.281999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:06.281999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:06.281999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:06.281999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:06.281999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:06.281999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:06.281999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:06.282807 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:06.282807 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:06.282807 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:06.282807 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:06.282807 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:06.282807 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:06.282807 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:06.282807 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:06.282807 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:06.282807 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:06.282807 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:06.282807 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:06.289843 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 108/213] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:06.291325 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc99c80-5ab2-4bee-9d6b-04084b237660 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:06.314098 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c6246-f49d-4ff8-8c17-2f5d1ec975bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:06.314915 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c6246-f49d-4ff8-8c17-2f5d1ec975bc None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:06.315256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c6246-f49d-4ff8-8c17-2f5d1ec975bc None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:06.315594 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c6246-f49d-4ff8-8c17-2f5d1ec975bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:06.317446 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c6246-f49d-4ff8-8c17-2f5d1ec975bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:06.319020 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c6246-f49d-4ff8-8c17-2f5d1ec975bc None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:06.321072 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 106/214] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:06.326883 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c6246-f49d-4ff8-8c17-2f5d1ec975bc None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:06.402261 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc99c80-5ab2-4bee-9d6b-04084b237660 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:06.421114 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:06.435093 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c6246-f49d-4ff8-8c17-2f5d1ec975bc None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:06.437529 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:06.438863 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9650ac6-28d7-43aa-94bc-dd5c10974a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:06.439706 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9650ac6-28d7-43aa-94bc-dd5c10974a6f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:06.440161 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9650ac6-28d7-43aa-94bc-dd5c10974a6f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:06.440606 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9650ac6-28d7-43aa-94bc-dd5c10974a6f None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:06.441714 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9650ac6-28d7-43aa-94bc-dd5c10974a6f None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:06.442201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9650ac6-28d7-43aa-94bc-dd5c10974a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:06.443793 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9650ac6-28d7-43aa-94bc-dd5c10974a6f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:06.452920 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 109/215] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:06.459008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9650ac6-28d7-43aa-94bc-dd5c10974a6f None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:06.474201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5a719-a070-483b-8b1a-10a61b262391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:06.474937 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5a719-a070-483b-8b1a-10a61b262391 None admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:06.475322 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5a719-a070-483b-8b1a-10a61b262391 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:06.475976 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5a719-a070-483b-8b1a-10a61b262391 None admin] PATH_INFO: `/v3/users` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:06.476517 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5a719-a070-483b-8b1a-10a61b262391 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:06.478192 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5a719-a070-483b-8b1a-10a61b262391 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:06.578202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 107/216] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Aug 19 19:12:06 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:12:06.590607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9650ac6-28d7-43aa-94bc-dd5c10974a6f None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:06.627322 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff81936-9bfb-48ff-8421-2460862fed65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:06.627977 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff81936-9bfb-48ff-8421-2460862fed65 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:06.628274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff81936-9bfb-48ff-8421-2460862fed65 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:06.628535 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff81936-9bfb-48ff-8421-2460862fed65 None admin] PATH_INFO: `/v3/users/3f2360e322624305b7c2ca03e805b9a8` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:06.645183 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff81936-9bfb-48ff-8421-2460862fed65 None admin] RBAC: Authorizing `identity:get_user(user_id=3f2360e322624305b7c2ca03e805b9a8)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:06.646709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff81936-9bfb-48ff-8421-2460862fed65 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:06.648488 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 110/217] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:06 2022] GET /identity/v3/users/3f2360e322624305b7c2ca03e805b9a8 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:06.655227 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5a719-a070-483b-8b1a-10a61b262391 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:06.778157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5a719-a070-483b-8b1a-10a61b262391 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:06.818260 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732c098-264f-483e-b5e7-ad9634be9138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:06.819267 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732c098-264f-483e-b5e7-ad9634be9138 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:06.819748 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732c098-264f-483e-b5e7-ad9634be9138 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:06.820242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732c098-264f-483e-b5e7-ad9634be9138 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:06.841608 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:06.893460 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732c098-264f-483e-b5e7-ad9634be9138 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:06.895185 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732c098-264f-483e-b5e7-ad9634be9138 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:06.969071 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e12b2c-fffb-4b33-afc0-ee105b838629 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:06.969247 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e12b2c-fffb-4b33-afc0-ee105b838629 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:06.969524 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e12b2c-fffb-4b33-afc0-ee105b838629 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:06.971074 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 111/218] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:06.976433 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa09577-f949-4d5f-aaa1-d7ee9ced2fcc None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:06.976714 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa09577-f949-4d5f-aaa1-d7ee9ced2fcc None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:06.976988 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa09577-f949-4d5f-aaa1-d7ee9ced2fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:07.001818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-6fa09577-f949-4d5f-aaa1-d7ee9ced2fcc None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:07.003246 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6fa09577-f949-4d5f-aaa1-d7ee9ced2fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:07.026567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 108/219] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:07.032228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732c098-264f-483e-b5e7-ad9634be9138 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:07.039674 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:07.089782 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 112/220] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:07.091135 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af7608-356a-4ee6-9451-9654148f84ec None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:07.091426 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af7608-356a-4ee6-9451-9654148f84ec None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:07.091709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af7608-356a-4ee6-9451-9654148f84ec None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:07.097112 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 113/221] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:07.097406 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:07.098269 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05894b43-4643-4bd6-8ad7-3c3f0bfe17fc None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:07.098575 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05894b43-4643-4bd6-8ad7-3c3f0bfe17fc None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:07.098855 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05894b43-4643-4bd6-8ad7-3c3f0bfe17fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:07.117970 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-05894b43-4643-4bd6-8ad7-3c3f0bfe17fc None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:07.119731 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-05894b43-4643-4bd6-8ad7-3c3f0bfe17fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:07.157087 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732c098-264f-483e-b5e7-ad9634be9138 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:07.207183 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b8cf4-43bf-4f25-8098-3151faa0c5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:07.207816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b8cf4-43bf-4f25-8098-3151faa0c5ba None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:07.208096 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b8cf4-43bf-4f25-8098-3151faa0c5ba None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:07.208367 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b8cf4-43bf-4f25-8098-3151faa0c5ba None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:07.209724 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b8cf4-43bf-4f25-8098-3151faa0c5ba None admin] RBAC: Authorizing `identity:get_project(project_id=35715c28855e4d0b93c644f5a3804760)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:07.211205 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b8cf4-43bf-4f25-8098-3151faa0c5ba None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:07.213063 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 109/222] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:07 2022] GET /identity/v3/projects/35715c28855e4d0b93c644f5a3804760 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:07.219664 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b8cf4-43bf-4f25-8098-3151faa0c5ba None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:07.226010 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 114/223] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:12:07.347918 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b8cf4-43bf-4f25-8098-3151faa0c5ba None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:07.367011 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:07.393276 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a4656-f435-45e3-9619-41ebbb2b31fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:07.393912 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4656-f435-45e3-9619-41ebbb2b31fa None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:07.394192 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4656-f435-45e3-9619-41ebbb2b31fa None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:07.394514 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4656-f435-45e3-9619-41ebbb2b31fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:07.395269 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a4656-f435-45e3-9619-41ebbb2b31fa None admin] RBAC: Adding query filter params (role.id=83a904d35afc48fe9f8d55c0fd1597d8, scope.project.id=35715c28855e4d0b93c644f5a3804760, user.id=3f2360e322624305b7c2ca03e805b9a8) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:07.395575 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a4656-f435-45e3-9619-41ebbb2b31fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:07.397087 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a4656-f435-45e3-9619-41ebbb2b31fa None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:07.403664 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 110/224] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:12:07 2022] GET /identity/v3/role_assignments?user.id=3f2360e322624305b7c2ca03e805b9a8&scope.project.id=35715c28855e4d0b93c644f5a3804760&role.id=83a904d35afc48fe9f8d55c0fd1597d8 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:07.472403 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05894b43-4643-4bd6-8ad7-3c3f0bfe17fc None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:07.632796 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:07.637609 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05894b43-4643-4bd6-8ad7-3c3f0bfe17fc None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:07.678140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8844aa-8b38-4bbe-aece-24c073ec93c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:07.678796 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8844aa-8b38-4bbe-aece-24c073ec93c7 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:07.679078 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8844aa-8b38-4bbe-aece-24c073ec93c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:07.679349 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8844aa-8b38-4bbe-aece-24c073ec93c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:07.691626 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8844aa-8b38-4bbe-aece-24c073ec93c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:07.696368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-ae8844aa-8b38-4bbe-aece-24c073ec93c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:12:07.696368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:07.696368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:07.696368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:07.696368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:07.696368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:07.696368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:07.696368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:07.696368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:07.696368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:07.696368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:07.696368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:07.696368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:07.696368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:07.696368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:07.696368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:07.697235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:07.697235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:07.697235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:07.697235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:07.697235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:07.697235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:07.697235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:07.697235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:07.697235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:07.697235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:07.697235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:07.697235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:07.697235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:07.697235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:07.697235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:07.697235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:07.698230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:07.698230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:07.698230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:07.698230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:07.698230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:07.698230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:07.698230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:07.698230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:07.698230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:07.698230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:07.698230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:12:07.698230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:07.698230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 115/225] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:12:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:07.700455 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a4656-f435-45e3-9619-41ebbb2b31fa None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:07.704789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8844aa-8b38-4bbe-aece-24c073ec93c7 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:07.805327 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a4656-f435-45e3-9619-41ebbb2b31fa None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:07.841396 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706be9f-2f98-4860-ad11-33b7f7499d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:07.842034 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706be9f-2f98-4860-ad11-33b7f7499d8c None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:07.842316 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706be9f-2f98-4860-ad11-33b7f7499d8c None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:07.842613 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706be9f-2f98-4860-ad11-33b7f7499d8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:07.853154 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706be9f-2f98-4860-ad11-33b7f7499d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:07.859248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-8706be9f-2f98-4860-ad11-33b7f7499d8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:12:07.859248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:07.859248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:07.859248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:07.859248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:07.859248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:07.859248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:07.859248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:07.859248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:07.859248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:07.859248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:07.859248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:07.859248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:07.859248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:07.859248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:07.859248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:07.861809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:07.861809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:07.861809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:07.861809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:07.861809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:07.861809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:07.861809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:07.861809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:07.861809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:07.861809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:07.861809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:07.861809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:07.861809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:07.861809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:07.861809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:07.861809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:07.863757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:07.863757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:07.863757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:07.863757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:07.863757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:07.863757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:07.863757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:07.863757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:07.863757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:07.863757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:07.863757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:12:07.863757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:07.863757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 111/226] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Aug 19 19:12:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:07.871829 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706be9f-2f98-4860-ad11-33b7f7499d8c None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:07.889715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8844aa-8b38-4bbe-aece-24c073ec93c7 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:07.928866 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75a9b9-5a90-4bad-ad07-ab331a9645f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:07.929549 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75a9b9-5a90-4bad-ad07-ab331a9645f8 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:07.929873 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75a9b9-5a90-4bad-ad07-ab331a9645f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:07.930152 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75a9b9-5a90-4bad-ad07-ab331a9645f8 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:07.930853 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75a9b9-5a90-4bad-ad07-ab331a9645f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:07.931255 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75a9b9-5a90-4bad-ad07-ab331a9645f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:07.932784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75a9b9-5a90-4bad-ad07-ab331a9645f8 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:07.942895 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 116/227] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:12:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:07.948069 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75a9b9-5a90-4bad-ad07-ab331a9645f8 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:07.964643 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:07.991812 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:08.088972 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75a9b9-5a90-4bad-ad07-ab331a9645f8 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:08.091220 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706be9f-2f98-4860-ad11-33b7f7499d8c None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:08.134287 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a815b-6c2e-4e2e-8dda-d0a06c161bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:08.135465 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a815b-6c2e-4e2e-8dda-d0a06c161bfe None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:08.135751 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a815b-6c2e-4e2e-8dda-d0a06c161bfe None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:08.136051 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a815b-6c2e-4e2e-8dda-d0a06c161bfe None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:08.136956 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb3ad0-abed-4571-a85d-720c82ccc5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:08.137596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb3ad0-abed-4571-a85d-720c82ccc5d5 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:08.137865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb3ad0-abed-4571-a85d-720c82ccc5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:08.138131 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb3ad0-abed-4571-a85d-720c82ccc5d5 None admin] PATH_INFO: `/v3/users/19d53e234aa1459a9113d8673ad6fb31` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:08.139257 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a815b-6c2e-4e2e-8dda-d0a06c161bfe None admin] RBAC: Adding query filter params (name=admin) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:08.139382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb3ad0-abed-4571-a85d-720c82ccc5d5 None admin] RBAC: Authorizing `identity:get_user(user_id=19d53e234aa1459a9113d8673ad6fb31)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:08.139573 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a815b-6c2e-4e2e-8dda-d0a06c161bfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:08.140776 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb3ad0-abed-4571-a85d-720c82ccc5d5 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:08.140954 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a815b-6c2e-4e2e-8dda-d0a06c161bfe None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:08.142706 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 117/228] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:07 2022] GET /identity/v3/users/19d53e234aa1459a9113d8673ad6fb31 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:08.148206 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb3ad0-abed-4571-a85d-720c82ccc5d5 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:08.165305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 112/229] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:08.174446 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a815b-6c2e-4e2e-8dda-d0a06c161bfe None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:08.310454 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a815b-6c2e-4e2e-8dda-d0a06c161bfe None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:08.320020 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:08.345752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10697dbf-ee7e-4950-9a77-86b94001dd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:08.346309 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10697dbf-ee7e-4950-9a77-86b94001dd9e None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:08.346615 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10697dbf-ee7e-4950-9a77-86b94001dd9e None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:08.346892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10697dbf-ee7e-4950-9a77-86b94001dd9e None admin] PATH_INFO: `/v3/users/19d53e234aa1459a9113d8673ad6fb31` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:08.348108 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10697dbf-ee7e-4950-9a77-86b94001dd9e None admin] RBAC: Authorizing `identity:get_user(user_id=19d53e234aa1459a9113d8673ad6fb31)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:08.349606 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10697dbf-ee7e-4950-9a77-86b94001dd9e None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:08.351426 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 113/230] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:08 2022] GET /identity/v3/users/19d53e234aa1459a9113d8673ad6fb31 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:08.357615 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10697dbf-ee7e-4950-9a77-86b94001dd9e None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:08.371792 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:08.404452 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb3ad0-abed-4571-a85d-720c82ccc5d5 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:08.464430 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10697dbf-ee7e-4950-9a77-86b94001dd9e None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:08.498656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e3dbf-8151-4784-a667-da9be15a4e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:08.499291 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e3dbf-8151-4784-a667-da9be15a4e48 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:08.499572 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e3dbf-8151-4784-a667-da9be15a4e48 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:08.499857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e3dbf-8151-4784-a667-da9be15a4e48 None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:08.501077 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e3dbf-8151-4784-a667-da9be15a4e48 None admin] RBAC: Authorizing `identity:get_project(project_id=35715c28855e4d0b93c644f5a3804760)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:08.502609 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e3dbf-8151-4784-a667-da9be15a4e48 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:08.503360 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a528816-1f15-4124-a72b-94ad710b191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:08.504009 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a528816-1f15-4124-a72b-94ad710b191b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:08.504284 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a528816-1f15-4124-a72b-94ad710b191b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:08.504617 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a528816-1f15-4124-a72b-94ad710b191b None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:08.504903 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 114/231] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:08 2022] GET /identity/v3/projects/35715c28855e4d0b93c644f5a3804760 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:08.506162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a528816-1f15-4124-a72b-94ad710b191b None admin] RBAC: Authorizing `identity:get_project(project_id=35715c28855e4d0b93c644f5a3804760)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:08.507645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a528816-1f15-4124-a72b-94ad710b191b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:08.509251 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 118/232] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:08 2022] GET /identity/v3/projects/35715c28855e4d0b93c644f5a3804760 => generated 302 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:08.510305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e3dbf-8151-4784-a667-da9be15a4e48 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:08.515361 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a528816-1f15-4124-a72b-94ad710b191b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:08.556507 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:08.616188 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e3dbf-8151-4784-a667-da9be15a4e48 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:08.651484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c71a1-5b8b-40b4-85f7-26611b8eaf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:08.652406 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c71a1-5b8b-40b4-85f7-26611b8eaf03 None admin] REQUEST_METHOD: `PUT` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:08.652825 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c71a1-5b8b-40b4-85f7-26611b8eaf03 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:08.653237 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c71a1-5b8b-40b4-85f7-26611b8eaf03 None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760/users/19d53e234aa1459a9113d8673ad6fb31/roles/8fdfbc4aaf68468f89a5ae3450b8488d` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:08.656190 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c71a1-5b8b-40b4-85f7-26611b8eaf03 None admin] RBAC: Authorizing `identity:create_grant(project_id=35715c28855e4d0b93c644f5a3804760, user_id=19d53e234aa1459a9113d8673ad6fb31, role_id=8fdfbc4aaf68468f89a5ae3450b8488d)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:08.659218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c71a1-5b8b-40b4-85f7-26611b8eaf03 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:08.719936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a528816-1f15-4124-a72b-94ad710b191b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:08.740755 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 115/233] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Aug 19 19:12:08 2022] PUT /identity/v3/projects/35715c28855e4d0b93c644f5a3804760/users/19d53e234aa1459a9113d8673ad6fb31/roles/8fdfbc4aaf68468f89a5ae3450b8488d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:12:08.757323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447f03c-514d-4aee-8b4a-93483c276550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:08.758010 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447f03c-514d-4aee-8b4a-93483c276550 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:08.758284 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447f03c-514d-4aee-8b4a-93483c276550 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:08.758573 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447f03c-514d-4aee-8b4a-93483c276550 None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760/users/19d53e234aa1459a9113d8673ad6fb31/roles/097319c04e61414e80385247dbf5003a` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:08.761819 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447f03c-514d-4aee-8b4a-93483c276550 None admin] RBAC: Authorizing `identity:create_grant(project_id=35715c28855e4d0b93c644f5a3804760, user_id=19d53e234aa1459a9113d8673ad6fb31, role_id=097319c04e61414e80385247dbf5003a)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:08.763471 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447f03c-514d-4aee-8b4a-93483c276550 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:08.891418 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 119/234] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Aug 19 19:12:08 2022] PUT /identity/v3/projects/35715c28855e4d0b93c644f5a3804760/users/19d53e234aa1459a9113d8673ad6fb31/roles/097319c04e61414e80385247dbf5003a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 19:12:09.480002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c781363-3799-44aa-8ea1-97ce5485b510 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:09.480711 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c781363-3799-44aa-8ea1-97ce5485b510 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:09.481211 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c781363-3799-44aa-8ea1-97ce5485b510 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:09.482791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 116/235] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:09.487962 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b89aeb-b0c1-4a30-b403-8a15d21deb0d None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:09.488479 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b89aeb-b0c1-4a30-b403-8a15d21deb0d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:09.488969 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b89aeb-b0c1-4a30-b403-8a15d21deb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:09.518961 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-27b89aeb-b0c1-4a30-b403-8a15d21deb0d None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:09.520578 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-27b89aeb-b0c1-4a30-b403-8a15d21deb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:09.532895 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:09.617120 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 120/236] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:09.627875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621faf3-5c8a-43a5-9894-63a2584deb24 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:09.628477 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621faf3-5c8a-43a5-9894-63a2584deb24 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:09.628967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621faf3-5c8a-43a5-9894-63a2584deb24 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:09.630811 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 117/237] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:09.636288 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60dd6f-a90c-47fc-99b7-71b6a373df8e None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:09.636844 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60dd6f-a90c-47fc-99b7-71b6a373df8e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:09.637317 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60dd6f-a90c-47fc-99b7-71b6a373df8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:09.655938 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-3f60dd6f-a90c-47fc-99b7-71b6a373df8e None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:09.657557 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3f60dd6f-a90c-47fc-99b7-71b6a373df8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:09.736421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 121/238] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:10.075812 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621faf3-5c8a-43a5-9894-63a2584deb24 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:10.165603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60dd6f-a90c-47fc-99b7-71b6a373df8e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:10.214929 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:10.215907 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621faf3-5c8a-43a5-9894-63a2584deb24 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:10.262478 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebae02-ff77-4760-902b-c417f920bbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:10.263200 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebae02-ff77-4760-902b-c417f920bbdb None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:10.263482 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebae02-ff77-4760-902b-c417f920bbdb None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:10.263794 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebae02-ff77-4760-902b-c417f920bbdb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:10.268178 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:10.277086 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bebae02-ff77-4760-902b-c417f920bbdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:10.283002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-3bebae02-ff77-4760-902b-c417f920bbdb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:12:10.283002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:10.283002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:10.283002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:10.283002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:10.283002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:10.283002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:10.283002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:10.283002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:10.283002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:10.283002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:10.283002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:10.283002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:10.283002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:10.283002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:10.283002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:10.283867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:10.283867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:10.283867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:10.283867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:10.283867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:10.283867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:10.283867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:10.283867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:10.283867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:10.283867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:10.283867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:10.283867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:10.283867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:10.283867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:10.283867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:10.283867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:10.284650 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:10.284650 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:10.284650 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:10.284650 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:10.284650 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:10.284650 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:10.284650 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:10.284650 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:10.284650 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:10.284650 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:10.284650 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:12:10.284650 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:10.284650 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 118/239] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:10.290560 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beee02a-f6e2-4eaa-a701-59fb028a0af7 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:10.290560 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beee02a-f6e2-4eaa-a701-59fb028a0af7 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:10.290560 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beee02a-f6e2-4eaa-a701-59fb028a0af7 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:10.290560 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 119/240] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:10.292495 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beee02a-f6e2-4eaa-a701-59fb028a0af7 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:10.306703 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60dd6f-a90c-47fc-99b7-71b6a373df8e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:10.414117 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff372d-a4e1-4c01-82f5-08226a32caf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:10.414751 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff372d-a4e1-4c01-82f5-08226a32caf8 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:10.415034 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff372d-a4e1-4c01-82f5-08226a32caf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:10.415307 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff372d-a4e1-4c01-82f5-08226a32caf8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:10.417439 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff372d-a4e1-4c01-82f5-08226a32caf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:10.418113 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff372d-a4e1-4c01-82f5-08226a32caf8 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:10.420771 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 122/241] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:10.421895 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760de3ca-2e24-4f44-ab52-0c7dc3d00bc7 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:10.422275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760de3ca-2e24-4f44-ab52-0c7dc3d00bc7 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:10.422582 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760de3ca-2e24-4f44-ab52-0c7dc3d00bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:10.444864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-760de3ca-2e24-4f44-ab52-0c7dc3d00bc7 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:10.446233 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-760de3ca-2e24-4f44-ab52-0c7dc3d00bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:10.496277 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beee02a-f6e2-4eaa-a701-59fb028a0af7 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:10.538155 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 123/242] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:10.539423 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760de3ca-2e24-4f44-ab52-0c7dc3d00bc7 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:10.540768 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911bfc9-dcf6-4cea-9387-e937feffb385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:10.542307 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911bfc9-dcf6-4cea-9387-e937feffb385 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:10.542307 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911bfc9-dcf6-4cea-9387-e937feffb385 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:10.542703 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911bfc9-dcf6-4cea-9387-e937feffb385 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:10.543383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911bfc9-dcf6-4cea-9387-e937feffb385 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:10.543753 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911bfc9-dcf6-4cea-9387-e937feffb385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:10.545938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911bfc9-dcf6-4cea-9387-e937feffb385 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:10.555852 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 120/243] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:10.561736 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911bfc9-dcf6-4cea-9387-e937feffb385 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:10.595741 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:10.652579 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:10.679653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760de3ca-2e24-4f44-ab52-0c7dc3d00bc7 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:10.689668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911bfc9-dcf6-4cea-9387-e937feffb385 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:10.718073 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0c696-d5ce-4b1c-8fbe-6686f5269b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:10.719074 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0c696-d5ce-4b1c-8fbe-6686f5269b06 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:10.719554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0c696-d5ce-4b1c-8fbe-6686f5269b06 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:10.720023 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0c696-d5ce-4b1c-8fbe-6686f5269b06 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:10.720881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0c696-d5ce-4b1c-8fbe-6686f5269b06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:10.722547 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0c696-d5ce-4b1c-8fbe-6686f5269b06 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:10.729993 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84457346-5999-4408-92c8-d430c5cb7389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:10.730732 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84457346-5999-4408-92c8-d430c5cb7389 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:10.731014 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84457346-5999-4408-92c8-d430c5cb7389 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:10.731287 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84457346-5999-4408-92c8-d430c5cb7389 None admin] PATH_INFO: `/v3/users/818b66215ece41abbe7033e517f8b835` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:10.746758 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84457346-5999-4408-92c8-d430c5cb7389 None admin] RBAC: Authorizing `identity:get_user(user_id=818b66215ece41abbe7033e517f8b835)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:10.748337 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84457346-5999-4408-92c8-d430c5cb7389 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:10.750346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 121/244] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:10 2022] GET /identity/v3/users/818b66215ece41abbe7033e517f8b835 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:10.755950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84457346-5999-4408-92c8-d430c5cb7389 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:10.814141 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 124/245] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Aug 19 19:12:10 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:12:10.849310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:10.872341 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84457346-5999-4408-92c8-d430c5cb7389 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:10.922468 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd321d55-0990-425f-987f-87148d4ed6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:10.923136 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd321d55-0990-425f-987f-87148d4ed6d4 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:10.923414 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd321d55-0990-425f-987f-87148d4ed6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:10.923685 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd321d55-0990-425f-987f-87148d4ed6d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:11.006296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd321d55-0990-425f-987f-87148d4ed6d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:11.008115 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd321d55-0990-425f-987f-87148d4ed6d4 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:11.023305 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0c696-d5ce-4b1c-8fbe-6686f5269b06 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:11.158255 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:11.190697 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 122/246] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 19:12:11.198513 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd321d55-0990-425f-987f-87148d4ed6d4 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:11.226646 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0c696-d5ce-4b1c-8fbe-6686f5269b06 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:11.272193 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:11.281766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c17b9-d753-4d90-9955-5d5873ab0d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:11.282841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c17b9-d753-4d90-9955-5d5873ab0d5c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:11.283333 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c17b9-d753-4d90-9955-5d5873ab0d5c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:11.283798 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c17b9-d753-4d90-9955-5d5873ab0d5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:11.299728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c17b9-d753-4d90-9955-5d5873ab0d5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:11.306209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-5b5c17b9-d753-4d90-9955-5d5873ab0d5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:11.306209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:11.306209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:11.306209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:11.306209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:11.306209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:11.306209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:11.306209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:11.306209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:11.306209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:11.306209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:11.306209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:11.306209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:11.306209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:11.306209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:11.306209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:11.307885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:11.307885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:11.307885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:11.307885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:11.307885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:11.307885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:11.307885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:11.307885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:11.307885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:11.307885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:11.307885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:11.307885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:11.307885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:11.307885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:11.307885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:11.307885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:11.308754 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:11.308754 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:11.308754 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:11.308754 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:11.308754 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:11.308754 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:11.308754 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:11.308754 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:11.308754 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:11.308754 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:11.308754 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:11.308754 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:11.309358 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 125/247] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:12:11.315410 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c17b9-d753-4d90-9955-5d5873ab0d5c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:11.325894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd321d55-0990-425f-987f-87148d4ed6d4 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:11.363278 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b63058-5846-497e-9b36-199cbafcdd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:11.364057 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b63058-5846-497e-9b36-199cbafcdd72 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:11.364407 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b63058-5846-497e-9b36-199cbafcdd72 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:11.364778 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b63058-5846-497e-9b36-199cbafcdd72 None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:11.366028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b63058-5846-497e-9b36-199cbafcdd72 None admin] RBAC: Authorizing `identity:get_project(project_id=35715c28855e4d0b93c644f5a3804760)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:11.367590 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b63058-5846-497e-9b36-199cbafcdd72 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:11.369974 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 123/248] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:11 2022] GET /identity/v3/projects/35715c28855e4d0b93c644f5a3804760 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:11.375716 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b63058-5846-497e-9b36-199cbafcdd72 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:11.443123 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c17b9-d753-4d90-9955-5d5873ab0d5c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:11.449349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:11.486837 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420097a-3a85-42e3-a547-f8abc1d1dbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:11.487749 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420097a-3a85-42e3-a547-f8abc1d1dbb9 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:11.488237 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420097a-3a85-42e3-a547-f8abc1d1dbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:11.488648 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420097a-3a85-42e3-a547-f8abc1d1dbb9 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:11.489459 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420097a-3a85-42e3-a547-f8abc1d1dbb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:11.489899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420097a-3a85-42e3-a547-f8abc1d1dbb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:11.491472 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420097a-3a85-42e3-a547-f8abc1d1dbb9 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:11.505893 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 126/249] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:11.511897 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420097a-3a85-42e3-a547-f8abc1d1dbb9 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:11.532601 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b63058-5846-497e-9b36-199cbafcdd72 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:11.580524 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f566f9-ea4d-4c02-b7bc-7cd2c45e174f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:11.581465 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f566f9-ea4d-4c02-b7bc-7cd2c45e174f None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:11.581941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f566f9-ea4d-4c02-b7bc-7cd2c45e174f None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:11.582415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f566f9-ea4d-4c02-b7bc-7cd2c45e174f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:11.583378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f566f9-ea4d-4c02-b7bc-7cd2c45e174f None admin] RBAC: Adding query filter params (role.id=14b4522936a24e78a58d9f0dcae537be, scope.project.id=35715c28855e4d0b93c644f5a3804760, user.id=818b66215ece41abbe7033e517f8b835) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:11.583905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f566f9-ea4d-4c02-b7bc-7cd2c45e174f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:11.587868 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f566f9-ea4d-4c02-b7bc-7cd2c45e174f None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:11.594710 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 124/250] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:12:11 2022] GET /identity/v3/role_assignments?user.id=818b66215ece41abbe7033e517f8b835&scope.project.id=35715c28855e4d0b93c644f5a3804760&role.id=14b4522936a24e78a58d9f0dcae537be => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:11.596827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:11.608947 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc861f2-14f9-4d46-abaa-6dc28ff11155 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:11.609586 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc861f2-14f9-4d46-abaa-6dc28ff11155 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:11.610291 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc861f2-14f9-4d46-abaa-6dc28ff11155 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:11.612380 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 125/251] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:11.619707 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883ee7e-0499-4db2-879c-77f62e320c79 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:11.620109 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883ee7e-0499-4db2-879c-77f62e320c79 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:11.620244 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883ee7e-0499-4db2-879c-77f62e320c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:11.644305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-9883ee7e-0499-4db2-879c-77f62e320c79 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:11.645656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-9883ee7e-0499-4db2-879c-77f62e320c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:11.677319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420097a-3a85-42e3-a547-f8abc1d1dbb9 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:11.738120 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cbce1-f36d-4048-b306-c9d024de06f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:11.738854 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cbce1-f36d-4048-b306-c9d024de06f9 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:11.739110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cbce1-f36d-4048-b306-c9d024de06f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:11.739380 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cbce1-f36d-4048-b306-c9d024de06f9 None admin] PATH_INFO: `/v3/users/3f2360e322624305b7c2ca03e805b9a8` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:11.740679 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cbce1-f36d-4048-b306-c9d024de06f9 None admin] RBAC: Authorizing `identity:get_user(user_id=3f2360e322624305b7c2ca03e805b9a8)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:11.742380 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cbce1-f36d-4048-b306-c9d024de06f9 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:11.744193 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 127/252] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:11 2022] GET /identity/v3/users/3f2360e322624305b7c2ca03e805b9a8 => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:11.745299 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 126/253] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:11.750132 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cbce1-f36d-4048-b306-c9d024de06f9 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:11.798376 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8383be8-ee8f-4bb0-9fc1-7c03670784ba None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:11.799004 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8383be8-ee8f-4bb0-9fc1-7c03670784ba None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:11.799471 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8383be8-ee8f-4bb0-9fc1-7c03670784ba None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:11.801393 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 127/254] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:11.808687 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a14b8-81a3-4a49-93a0-d901a7bd7053 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:11.808959 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a14b8-81a3-4a49-93a0-d901a7bd7053 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:11.809229 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a14b8-81a3-4a49-93a0-d901a7bd7053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:11.835077 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-b53a14b8-81a3-4a49-93a0-d901a7bd7053 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:11.836241 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-b53a14b8-81a3-4a49-93a0-d901a7bd7053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:11.881615 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:11.905077 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cbce1-f36d-4048-b306-c9d024de06f9 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:11.941780 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:11.943055 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 128/255] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:12:11.977650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a90e51-c600-4c7b-aa68-51dca2da83a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:11.978305 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a90e51-c600-4c7b-aa68-51dca2da83a0 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:11.978649 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a90e51-c600-4c7b-aa68-51dca2da83a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:11.978930 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a90e51-c600-4c7b-aa68-51dca2da83a0 None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:11.980196 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a90e51-c600-4c7b-aa68-51dca2da83a0 None admin] RBAC: Authorizing `identity:get_project(project_id=35715c28855e4d0b93c644f5a3804760)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:11.981659 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a90e51-c600-4c7b-aa68-51dca2da83a0 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:11.983638 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 128/256] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:11 2022] GET /identity/v3/projects/35715c28855e4d0b93c644f5a3804760 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:11.989543 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a14b8-81a3-4a49-93a0-d901a7bd7053 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:12.128312 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a90e51-c600-4c7b-aa68-51dca2da83a0 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:12.135759 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a14b8-81a3-4a49-93a0-d901a7bd7053 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:12.178338 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61eb5c-b81b-42b9-ab7c-4b11af10eaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:12.179852 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61eb5c-b81b-42b9-ab7c-4b11af10eaf7 None admin] REQUEST_METHOD: `PUT` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:12.180423 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61eb5c-b81b-42b9-ab7c-4b11af10eaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:12.180914 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61eb5c-b81b-42b9-ab7c-4b11af10eaf7 None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760/users/3f2360e322624305b7c2ca03e805b9a8/roles/83a904d35afc48fe9f8d55c0fd1597d8` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:12.183867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61eb5c-b81b-42b9-ab7c-4b11af10eaf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=35715c28855e4d0b93c644f5a3804760, user_id=3f2360e322624305b7c2ca03e805b9a8, role_id=83a904d35afc48fe9f8d55c0fd1597d8)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:12.185697 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61eb5c-b81b-42b9-ab7c-4b11af10eaf7 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:12.293475 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 129/257] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Aug 19 19:12:11 2022] PUT /identity/v3/projects/35715c28855e4d0b93c644f5a3804760/users/3f2360e322624305b7c2ca03e805b9a8/roles/83a904d35afc48fe9f8d55c0fd1597d8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:12:12.297481 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a90e51-c600-4c7b-aa68-51dca2da83a0 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:12.320794 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61eb5c-b81b-42b9-ab7c-4b11af10eaf7 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:12.363452 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19237ab0-6fcc-4a68-aef7-52b563382fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:12.364117 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19237ab0-6fcc-4a68-aef7-52b563382fd4 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:12.364404 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19237ab0-6fcc-4a68-aef7-52b563382fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:12.364841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19237ab0-6fcc-4a68-aef7-52b563382fd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:12.381133 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:12.389966 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19237ab0-6fcc-4a68-aef7-52b563382fd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:12.396064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-19237ab0-6fcc-4a68-aef7-52b563382fd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:12:12.396064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:12.396064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:12.396064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:12.396064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:12.396064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:12.396064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:12.396064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:12.396064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:12.396064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:12.396064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:12.396064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:12.396064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:12.396064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:12.396064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:12.396064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:12.403104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:12.403104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:12.403104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:12.403104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:12.403104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:12.403104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:12.403104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:12.403104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:12.403104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:12.403104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:12.403104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:12.403104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:12.403104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:12.403104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:12.403104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:12.403104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:12.403899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:12.403899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:12.403899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:12.403899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:12.403899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:12.403899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:12.403899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:12.403899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:12.403899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:12.403899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:12.403899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:12:12.403899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:12.403899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 129/258] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Aug 19 19:12:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:12:12.403899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19237ab0-6fcc-4a68-aef7-52b563382fd4 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:12.519688 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:12.545031 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61eb5c-b81b-42b9-ab7c-4b11af10eaf7 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:12.627169 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdd5cc-d3da-4ad9-b0f8-af8cf1a35e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:12.628046 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdd5cc-d3da-4ad9-b0f8-af8cf1a35e75 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:12.628500 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdd5cc-d3da-4ad9-b0f8-af8cf1a35e75 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:12.628926 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdd5cc-d3da-4ad9-b0f8-af8cf1a35e75 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:12.640223 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19237ab0-6fcc-4a68-aef7-52b563382fd4 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:12.659201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdd5cc-d3da-4ad9-b0f8-af8cf1a35e75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:12.663982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-52cdd5cc-d3da-4ad9-b0f8-af8cf1a35e75 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:12:12.663982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:12.663982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:12.663982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:12.663982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:12.663982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:12.663982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:12.663982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:12.663982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:12.663982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:12.663982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:12.663982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:12.663982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:12.663982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:12.663982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:12.663982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:12.664864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:12.664864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:12.664864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:12.664864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:12.664864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:12.664864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:12.664864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:12.664864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:12.664864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:12.664864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:12.664864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:12.664864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:12.664864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:12.664864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:12.664864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:12.664864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:12.666407 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:12.666407 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:12.666407 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:12.666407 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:12.666407 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:12.666407 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:12.666407 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:12.666407 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:12.666407 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:12.666407 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:12.666407 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:12:12.666407 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:12.666407 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 130/259] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:12:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:12.672886 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdd5cc-d3da-4ad9-b0f8-af8cf1a35e75 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:12.688611 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef92d6d-d7fb-489e-a011-d7f7a72c8c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:12.689506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef92d6d-d7fb-489e-a011-d7f7a72c8c31 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:12.689999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef92d6d-d7fb-489e-a011-d7f7a72c8c31 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:12.690438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef92d6d-d7fb-489e-a011-d7f7a72c8c31 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:12.691737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef92d6d-d7fb-489e-a011-d7f7a72c8c31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:12.692283 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef92d6d-d7fb-489e-a011-d7f7a72c8c31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:12.693889 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef92d6d-d7fb-489e-a011-d7f7a72c8c31 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:12.704118 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 130/260] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:12.711584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef92d6d-d7fb-489e-a011-d7f7a72c8c31 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:12.896636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef92d6d-d7fb-489e-a011-d7f7a72c8c31 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:12.908336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:12.938490 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1549b5-fa49-4b0d-baf1-2043aefca1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:12.939631 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1549b5-fa49-4b0d-baf1-2043aefca1a1 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:12.940099 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1549b5-fa49-4b0d-baf1-2043aefca1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:12.940559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1549b5-fa49-4b0d-baf1-2043aefca1a1 None admin] PATH_INFO: `/v3/users/19d53e234aa1459a9113d8673ad6fb31` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:12.942193 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1549b5-fa49-4b0d-baf1-2043aefca1a1 None admin] RBAC: Authorizing `identity:get_user(user_id=19d53e234aa1459a9113d8673ad6fb31)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:12.943994 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1549b5-fa49-4b0d-baf1-2043aefca1a1 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:12.945910 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 131/261] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:12 2022] GET /identity/v3/users/19d53e234aa1459a9113d8673ad6fb31 => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:12.951638 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:12.953092 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1549b5-fa49-4b0d-baf1-2043aefca1a1 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:12.972788 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdd5cc-d3da-4ad9-b0f8-af8cf1a35e75 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:13.062817 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1549b5-fa49-4b0d-baf1-2043aefca1a1 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:13.071827 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f725710-dd76-447d-ab1a-993b002d3e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:13.073174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f725710-dd76-447d-ab1a-993b002d3e70 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:13.073461 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f725710-dd76-447d-ab1a-993b002d3e70 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:13.073724 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f725710-dd76-447d-ab1a-993b002d3e70 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:13.074397 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f725710-dd76-447d-ab1a-993b002d3e70 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:13.074772 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f725710-dd76-447d-ab1a-993b002d3e70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:13.076161 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f725710-dd76-447d-ab1a-993b002d3e70 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:13.098085 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 131/262] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:12:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:13.101996 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3707522-1b87-4ed1-8c91-6a26dae21bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:13.103259 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3707522-1b87-4ed1-8c91-6a26dae21bb2 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:13.103755 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f725710-dd76-447d-ab1a-993b002d3e70 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:13.103956 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3707522-1b87-4ed1-8c91-6a26dae21bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:13.104465 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3707522-1b87-4ed1-8c91-6a26dae21bb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:13.163011 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:13.179951 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3707522-1b87-4ed1-8c91-6a26dae21bb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:13.182303 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3707522-1b87-4ed1-8c91-6a26dae21bb2 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:13.289611 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f725710-dd76-447d-ab1a-993b002d3e70 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:13.296342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 132/263] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:13.304067 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3707522-1b87-4ed1-8c91-6a26dae21bb2 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:13.360513 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615b744-bf40-4d7b-8e78-1c8cb60bb1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:13.361203 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615b744-bf40-4d7b-8e78-1c8cb60bb1a0 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:13.361485 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615b744-bf40-4d7b-8e78-1c8cb60bb1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:13.361757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615b744-bf40-4d7b-8e78-1c8cb60bb1a0 None admin] PATH_INFO: `/v3/users/19d53e234aa1459a9113d8673ad6fb31` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:13.368509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615b744-bf40-4d7b-8e78-1c8cb60bb1a0 None admin] RBAC: Authorizing `identity:get_user(user_id=19d53e234aa1459a9113d8673ad6fb31)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:13.368509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615b744-bf40-4d7b-8e78-1c8cb60bb1a0 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:13.370758 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 132/264] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:13 2022] GET /identity/v3/users/19d53e234aa1459a9113d8673ad6fb31 => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:13.376194 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615b744-bf40-4d7b-8e78-1c8cb60bb1a0 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:13.424534 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:13.470341 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:13.519865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3707522-1b87-4ed1-8c91-6a26dae21bb2 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:13.607294 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615b744-bf40-4d7b-8e78-1c8cb60bb1a0 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:13.635911 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd5a29-ac50-400f-92cb-a23a5786191a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:13.636553 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd5a29-ac50-400f-92cb-a23a5786191a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:13.636834 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd5a29-ac50-400f-92cb-a23a5786191a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:13.637104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd5a29-ac50-400f-92cb-a23a5786191a None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:13.639642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd5a29-ac50-400f-92cb-a23a5786191a None admin] RBAC: Authorizing `identity:get_project(project_id=35715c28855e4d0b93c644f5a3804760)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:13.641650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd5a29-ac50-400f-92cb-a23a5786191a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:13.643874 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 133/265] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:13 2022] GET /identity/v3/projects/35715c28855e4d0b93c644f5a3804760 => generated 302 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:13.649524 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd5a29-ac50-400f-92cb-a23a5786191a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:13.687295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a853e8e-fdf2-408f-b880-263db767f5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:13.688035 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a853e8e-fdf2-408f-b880-263db767f5d8 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:13.688272 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a853e8e-fdf2-408f-b880-263db767f5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:13.688536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a853e8e-fdf2-408f-b880-263db767f5d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:13.843612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a853e8e-fdf2-408f-b880-263db767f5d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:13.845162 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a853e8e-fdf2-408f-b880-263db767f5d8 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:13.871296 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd5a29-ac50-400f-92cb-a23a5786191a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:13.926609 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:13.980424 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188be949-05a5-4d54-84c7-4c1749673659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:13.981321 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188be949-05a5-4d54-84c7-4c1749673659 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:13.981321 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188be949-05a5-4d54-84c7-4c1749673659 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:13.981501 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188be949-05a5-4d54-84c7-4c1749673659 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:13.982248 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188be949-05a5-4d54-84c7-4c1749673659 None admin] RBAC: Adding query filter params (role.id=8fdfbc4aaf68468f89a5ae3450b8488d, scope.project.id=35715c28855e4d0b93c644f5a3804760, user.id=19d53e234aa1459a9113d8673ad6fb31) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:13.982548 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188be949-05a5-4d54-84c7-4c1749673659 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:13.984014 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188be949-05a5-4d54-84c7-4c1749673659 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:13.997255 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 134/266] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:12:13 2022] GET /identity/v3/role_assignments?user.id=19d53e234aa1459a9113d8673ad6fb31&scope.project.id=35715c28855e4d0b93c644f5a3804760&role.id=8fdfbc4aaf68468f89a5ae3450b8488d => generated 608 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:14.136796 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 133/267] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 761 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 19:12:14.167694 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188be949-05a5-4d54-84c7-4c1749673659 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:14.198915 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:14.336967 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188be949-05a5-4d54-84c7-4c1749673659 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:14.385731 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723ca75-f304-4126-8b09-b27fb85fe2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:14.386763 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723ca75-f304-4126-8b09-b27fb85fe2df None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:14.387240 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723ca75-f304-4126-8b09-b27fb85fe2df None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:14.387707 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723ca75-f304-4126-8b09-b27fb85fe2df None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:14.390567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723ca75-f304-4126-8b09-b27fb85fe2df None admin] RBAC: Authorizing `identity:get_project(project_id=35715c28855e4d0b93c644f5a3804760)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:14.392376 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723ca75-f304-4126-8b09-b27fb85fe2df None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:14.394297 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 135/268] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:14 2022] GET /identity/v3/projects/35715c28855e4d0b93c644f5a3804760 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:14.400121 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a853e8e-fdf2-408f-b880-263db767f5d8 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:14.529452 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a853e8e-fdf2-408f-b880-263db767f5d8 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:14.560797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:14.578337 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762150a-d946-4ec3-afba-14f9f2203fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:14.578337 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762150a-d946-4ec3-afba-14f9f2203fe3 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:14.578337 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762150a-d946-4ec3-afba-14f9f2203fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:14.578622 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762150a-d946-4ec3-afba-14f9f2203fe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:14.579266 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762150a-d946-4ec3-afba-14f9f2203fe3 None admin] RBAC: Adding query filter params (role.id=097319c04e61414e80385247dbf5003a, scope.project.id=35715c28855e4d0b93c644f5a3804760, user.id=19d53e234aa1459a9113d8673ad6fb31) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:14.579574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762150a-d946-4ec3-afba-14f9f2203fe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:14.581054 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762150a-d946-4ec3-afba-14f9f2203fe3 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:14.587544 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 134/269] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:12:14 2022] GET /identity/v3/role_assignments?user.id=19d53e234aa1459a9113d8673ad6fb31&scope.project.id=35715c28855e4d0b93c644f5a3804760&role.id=097319c04e61414e80385247dbf5003a => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:14.933706 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44147e98-f7be-4e2a-8aeb-6c5a10242ba1 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:14.934254 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44147e98-f7be-4e2a-8aeb-6c5a10242ba1 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:14.934836 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44147e98-f7be-4e2a-8aeb-6c5a10242ba1 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:14.936453 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 136/270] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:14.942887 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c89e7-eb53-4d7e-b75a-3446fb15e71e None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:14.943171 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c89e7-eb53-4d7e-b75a-3446fb15e71e None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:14.943443 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c89e7-eb53-4d7e-b75a-3446fb15e71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:14.956405 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ddfb1-f2e0-4214-bfb8-5e605b080c94 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:14.956997 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ddfb1-f2e0-4214-bfb8-5e605b080c94 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:14.957473 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ddfb1-f2e0-4214-bfb8-5e605b080c94 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:14.959501 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 137/271] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:14.965428 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86284d47-c4ef-4258-b18d-fcf12324cf3a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:14.965989 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86284d47-c4ef-4258-b18d-fcf12324cf3a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:14.966458 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86284d47-c4ef-4258-b18d-fcf12324cf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:14.971489 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-4f9c89e7-eb53-4d7e-b75a-3446fb15e71e None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:14.972914 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-4f9c89e7-eb53-4d7e-b75a-3446fb15e71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:14.988022 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-86284d47-c4ef-4258-b18d-fcf12324cf3a None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:14.989236 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-86284d47-c4ef-4258-b18d-fcf12324cf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:15.066882 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 135/272] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:15.068162 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a1537-2812-4f09-bd7c-d6d42dbf7523 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:15.068446 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a1537-2812-4f09-bd7c-d6d42dbf7523 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:15.068728 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a1537-2812-4f09-bd7c-d6d42dbf7523 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:15.070152 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 136/273] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:15.075963 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75970811-5583-4719-96c7-9c492a6b4709 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:15.076243 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75970811-5583-4719-96c7-9c492a6b4709 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:15.076516 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75970811-5583-4719-96c7-9c492a6b4709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:15.083926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 138/274] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:12:15.101545 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-75970811-5583-4719-96c7-9c492a6b4709 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:15.102776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-75970811-5583-4719-96c7-9c492a6b4709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:15.172941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 137/275] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:15.404894 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86284d47-c4ef-4258-b18d-fcf12324cf3a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:15.415583 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:15.437707 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75970811-5583-4719-96c7-9c492a6b4709 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:15.500260 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:15.516428 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86284d47-c4ef-4258-b18d-fcf12324cf3a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:15.551352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d1b93-e9f3-4f64-8930-357b7fb48778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:15.551999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d1b93-e9f3-4f64-8930-357b7fb48778 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:15.552274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d1b93-e9f3-4f64-8930-357b7fb48778 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:15.552542 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d1b93-e9f3-4f64-8930-357b7fb48778 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:15.553661 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d1b93-e9f3-4f64-8930-357b7fb48778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:15.555182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d1b93-e9f3-4f64-8930-357b7fb48778 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:15.557462 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 139/276] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:15.560088 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397eb66-1eff-4d4e-8bfe-75df313d1f99 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:15.560377 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397eb66-1eff-4d4e-8bfe-75df313d1f99 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:15.560668 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397eb66-1eff-4d4e-8bfe-75df313d1f99 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:15.563622 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 140/277] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:15.564371 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397eb66-1eff-4d4e-8bfe-75df313d1f99 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:15.569615 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75970811-5583-4719-96c7-9c492a6b4709 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:15.606536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479feda0-aac5-4d2d-a85d-6b5cf17636c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:15.607164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479feda0-aac5-4d2d-a85d-6b5cf17636c6 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:15.607440 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479feda0-aac5-4d2d-a85d-6b5cf17636c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:15.607707 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479feda0-aac5-4d2d-a85d-6b5cf17636c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:15.617502 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479feda0-aac5-4d2d-a85d-6b5cf17636c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:15.622838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-479feda0-aac5-4d2d-a85d-6b5cf17636c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:15.622838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:15.622838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:15.622838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:15.622838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:15.622838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:15.622838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:15.622838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:15.622838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:15.622838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:15.622838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:15.622838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:15.622838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:15.622838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:15.622838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:15.622838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:15.623799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:15.623799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:15.623799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:15.623799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:15.623799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:15.623799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:15.623799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:15.623799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:15.623799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:15.623799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:15.623799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:15.623799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:15.623799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:15.623799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:15.623799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:15.623799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:15.624566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:15.624566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:15.624566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:15.624566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:15.624566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:15.624566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:15.624566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:15.624566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:15.624566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:15.624566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:15.624566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:15.624566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:15.624566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 138/278] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:15.625221 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479feda0-aac5-4d2d-a85d-6b5cf17636c6 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:15.644963 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:15.668528 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397eb66-1eff-4d4e-8bfe-75df313d1f99 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:15.703093 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d4deb-0bb6-4083-a0fb-5adcaf63ec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:15.703726 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d4deb-0bb6-4083-a0fb-5adcaf63ec65 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:15.703997 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d4deb-0bb6-4083-a0fb-5adcaf63ec65 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:15.704266 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d4deb-0bb6-4083-a0fb-5adcaf63ec65 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:15.714826 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d4deb-0bb6-4083-a0fb-5adcaf63ec65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:15.719536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-379d4deb-0bb6-4083-a0fb-5adcaf63ec65 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:12:15.719536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:15.719536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:15.719536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:15.719536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:15.719536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:15.719536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:15.719536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:15.719536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:15.719536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:15.719536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:15.719536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:15.719536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:15.719536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:15.719536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:15.719536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:15.720784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:15.720784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:15.720784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:15.720784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:15.720784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:15.720784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:15.720784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:15.720784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:15.720784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:15.720784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:15.720784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:15.720784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:15.720784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:15.720784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:15.720784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:15.720784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:15.721715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:15.721715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:15.721715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:15.721715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:15.721715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:15.721715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:15.721715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:15.721715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:15.721715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:15.721715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:15.721715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:12:15.721715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:15.721715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 141/279] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:15.721715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a8d21-d367-4675-b25f-2ac98c5167dd None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:15.722554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a8d21-d367-4675-b25f-2ac98c5167dd None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:15.722554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a8d21-d367-4675-b25f-2ac98c5167dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:15.728051 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479feda0-aac5-4d2d-a85d-6b5cf17636c6 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:15.735910 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:15.739968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-b90a8d21-d367-4675-b25f-2ac98c5167dd None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:15.741169 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b90a8d21-d367-4675-b25f-2ac98c5167dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:15.762955 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838bef1-6c84-4bca-9112-1b1d7b08844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:15.763753 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838bef1-6c84-4bca-9112-1b1d7b08844a None admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:15.764030 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838bef1-6c84-4bca-9112-1b1d7b08844a None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:15.764297 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838bef1-6c84-4bca-9112-1b1d7b08844a None admin] PATH_INFO: `/v3/users` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:15.764920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838bef1-6c84-4bca-9112-1b1d7b08844a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:15.766362 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838bef1-6c84-4bca-9112-1b1d7b08844a None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:15.808013 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 142/280] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:15.808952 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a8d21-d367-4675-b25f-2ac98c5167dd None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:15.861717 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 139/281] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Aug 19 19:12:15 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:12:15.862912 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838bef1-6c84-4bca-9112-1b1d7b08844a None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:15.890546 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:15.948693 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a8d21-d367-4675-b25f-2ac98c5167dd None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:15.989011 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85408523-46f8-481a-9bd1-24860fa3dee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:15.989647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85408523-46f8-481a-9bd1-24860fa3dee6 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:15.989944 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85408523-46f8-481a-9bd1-24860fa3dee6 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:15.990166 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85408523-46f8-481a-9bd1-24860fa3dee6 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:15.990899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85408523-46f8-481a-9bd1-24860fa3dee6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:15.991204 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85408523-46f8-481a-9bd1-24860fa3dee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:15.992612 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85408523-46f8-481a-9bd1-24860fa3dee6 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:16.002441 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 143/282] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:16.010595 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85408523-46f8-481a-9bd1-24860fa3dee6 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:16.010779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838bef1-6c84-4bca-9112-1b1d7b08844a None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:16.060720 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2ebf1-aafc-4f11-ab89-0227f65f10a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:16.060720 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2ebf1-aafc-4f11-ab89-0227f65f10a0 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:16.060720 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2ebf1-aafc-4f11-ab89-0227f65f10a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:16.061145 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2ebf1-aafc-4f11-ab89-0227f65f10a0 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:16.063039 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2ebf1-aafc-4f11-ab89-0227f65f10a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:16.063039 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2ebf1-aafc-4f11-ab89-0227f65f10a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:16.063685 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2ebf1-aafc-4f11-ab89-0227f65f10a0 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:16.075628 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 140/283] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:16.082913 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2ebf1-aafc-4f11-ab89-0227f65f10a0 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:16.114611 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:16.148378 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85408523-46f8-481a-9bd1-24860fa3dee6 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:16.183426 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:16.193901 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732dd23-3900-41a5-a51d-324c5bc91c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:16.194795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732dd23-3900-41a5-a51d-324c5bc91c32 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:16.195179 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732dd23-3900-41a5-a51d-324c5bc91c32 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:16.195556 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732dd23-3900-41a5-a51d-324c5bc91c32 None admin] PATH_INFO: `/v3/users/e9de3735f2e44acdb955df4c47cfa2cf` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:16.215153 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732dd23-3900-41a5-a51d-324c5bc91c32 None admin] RBAC: Authorizing `identity:get_user(user_id=e9de3735f2e44acdb955df4c47cfa2cf)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:16.216555 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732dd23-3900-41a5-a51d-324c5bc91c32 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:16.217360 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2ebf1-aafc-4f11-ab89-0227f65f10a0 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:16.218250 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 144/284] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:16 2022] GET /identity/v3/users/e9de3735f2e44acdb955df4c47cfa2cf => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:16.219674 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732dd23-3900-41a5-a51d-324c5bc91c32 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:16.262808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16899a7-21e0-416d-8daf-e942193e6dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:16.263442 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16899a7-21e0-416d-8daf-e942193e6dc0 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:16.263721 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16899a7-21e0-416d-8daf-e942193e6dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:16.263984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16899a7-21e0-416d-8daf-e942193e6dc0 None admin] PATH_INFO: `/v3/users/818b66215ece41abbe7033e517f8b835` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:16.265167 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16899a7-21e0-416d-8daf-e942193e6dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=818b66215ece41abbe7033e517f8b835)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:16.266755 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16899a7-21e0-416d-8daf-e942193e6dc0 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:16.268655 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 141/285] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:16 2022] GET /identity/v3/users/818b66215ece41abbe7033e517f8b835 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:16.269838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16899a7-21e0-416d-8daf-e942193e6dc0 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:16.349446 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732dd23-3900-41a5-a51d-324c5bc91c32 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:16.378646 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:16.387725 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16899a7-21e0-416d-8daf-e942193e6dc0 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:16.399278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef12beb-8234-4893-91be-40195b4e85b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:16.399973 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef12beb-8234-4893-91be-40195b4e85b3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:16.400972 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef12beb-8234-4893-91be-40195b4e85b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:16.401252 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef12beb-8234-4893-91be-40195b4e85b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:16.412171 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef12beb-8234-4893-91be-40195b4e85b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:16.419329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-8ef12beb-8234-4893-91be-40195b4e85b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:16.419329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:16.419329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:16.419329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:16.419329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:16.419329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:16.419329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:16.419329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:16.419329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:16.419329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:16.419329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:16.419329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:16.419329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:16.419329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:16.419329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:16.419329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:16.420220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:16.420220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:16.420220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:16.420220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:16.420220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:16.420220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:16.420220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:16.420220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:16.420220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:16.420220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:16.420220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:16.420220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:16.420220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:16.420220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:16.420220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:16.420220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:16.421011 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:16.421011 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:16.421011 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:16.421011 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:16.421011 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:16.421011 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:16.421011 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:16.421011 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:16.421011 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:16.421011 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:16.421011 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:16.421011 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:16.421011 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 145/286] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:16.422121 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef12beb-8234-4893-91be-40195b4e85b3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:16.426576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36909398-21d7-491b-a2f4-ea8dcd99ef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:16.427447 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36909398-21d7-491b-a2f4-ea8dcd99ef85 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:16.427732 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36909398-21d7-491b-a2f4-ea8dcd99ef85 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:16.428012 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36909398-21d7-491b-a2f4-ea8dcd99ef85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:16.428746 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36909398-21d7-491b-a2f4-ea8dcd99ef85 None admin] RBAC: Adding query filter params (role.id=83a904d35afc48fe9f8d55c0fd1597d8, user.id=e9de3735f2e44acdb955df4c47cfa2cf, scope.system=all) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:16.429053 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36909398-21d7-491b-a2f4-ea8dcd99ef85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:16.430581 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36909398-21d7-491b-a2f4-ea8dcd99ef85 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:16.436552 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 142/287] 10.222.0.61 () {56 vars in 1308 bytes} [Fri Aug 19 19:12:16 2022] GET /identity/v3/role_assignments?user.id=e9de3735f2e44acdb955df4c47cfa2cf&scope.system=all&role.id=83a904d35afc48fe9f8d55c0fd1597d8 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:16.437391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36909398-21d7-491b-a2f4-ea8dcd99ef85 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:16.478469 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:16.539474 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef12beb-8234-4893-91be-40195b4e85b3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:16.561821 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36909398-21d7-491b-a2f4-ea8dcd99ef85 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:16.592625 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57d25b-4a6a-4694-9639-029f90f5da7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:16.593285 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57d25b-4a6a-4694-9639-029f90f5da7c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:16.593563 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57d25b-4a6a-4694-9639-029f90f5da7c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:16.593865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57d25b-4a6a-4694-9639-029f90f5da7c None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:16.595832 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57d25b-4a6a-4694-9639-029f90f5da7c None admin] RBAC: Authorizing `identity:get_project(project_id=35715c28855e4d0b93c644f5a3804760)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:16.597243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57d25b-4a6a-4694-9639-029f90f5da7c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:16.600086 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 146/288] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:16 2022] GET /identity/v3/projects/35715c28855e4d0b93c644f5a3804760 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:16.606481 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57d25b-4a6a-4694-9639-029f90f5da7c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:16.615122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a51f1-39e6-4fa3-b132-dcf29eeb20a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:16.615808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a51f1-39e6-4fa3-b132-dcf29eeb20a8 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:16.616091 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a51f1-39e6-4fa3-b132-dcf29eeb20a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:16.616373 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a51f1-39e6-4fa3-b132-dcf29eeb20a8 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:16.617114 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a51f1-39e6-4fa3-b132-dcf29eeb20a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:16.617424 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a51f1-39e6-4fa3-b132-dcf29eeb20a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:16.619383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a51f1-39e6-4fa3-b132-dcf29eeb20a8 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:16.628557 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 143/289] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:16.634232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a51f1-39e6-4fa3-b132-dcf29eeb20a8 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:16.667810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:16.723800 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57d25b-4a6a-4694-9639-029f90f5da7c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:16.740396 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:16.766302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9933d6-b5f5-47cd-af80-2fbc209bde79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:16.767259 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9933d6-b5f5-47cd-af80-2fbc209bde79 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:16.767664 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9933d6-b5f5-47cd-af80-2fbc209bde79 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:16.768057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9933d6-b5f5-47cd-af80-2fbc209bde79 None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760/users/818b66215ece41abbe7033e517f8b835/roles/14b4522936a24e78a58d9f0dcae537be` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:16.771849 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9933d6-b5f5-47cd-af80-2fbc209bde79 None admin] RBAC: Authorizing `identity:create_grant(project_id=35715c28855e4d0b93c644f5a3804760, user_id=818b66215ece41abbe7033e517f8b835, role_id=14b4522936a24e78a58d9f0dcae537be)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:16.774544 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9933d6-b5f5-47cd-af80-2fbc209bde79 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:16.803952 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a51f1-39e6-4fa3-b132-dcf29eeb20a8 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:16.842482 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b297b53-f209-4fa7-b7b7-e7e4244dfc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:16.843236 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b297b53-f209-4fa7-b7b7-e7e4244dfc52 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:16.843629 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b297b53-f209-4fa7-b7b7-e7e4244dfc52 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:16.844039 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b297b53-f209-4fa7-b7b7-e7e4244dfc52 None admin] PATH_INFO: `/v3/users/3f2360e322624305b7c2ca03e805b9a8` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:16.845403 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b297b53-f209-4fa7-b7b7-e7e4244dfc52 None admin] RBAC: Authorizing `identity:get_user(user_id=3f2360e322624305b7c2ca03e805b9a8)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:16.846933 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b297b53-f209-4fa7-b7b7-e7e4244dfc52 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:16.849172 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 144/290] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:16 2022] GET /identity/v3/users/3f2360e322624305b7c2ca03e805b9a8 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:16.855742 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b297b53-f209-4fa7-b7b7-e7e4244dfc52 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:16.866025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 147/291] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Aug 19 19:12:16 2022] PUT /identity/v3/projects/35715c28855e4d0b93c644f5a3804760/users/818b66215ece41abbe7033e517f8b835/roles/14b4522936a24e78a58d9f0dcae537be => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:12:16.950336 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:16.967720 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b297b53-f209-4fa7-b7b7-e7e4244dfc52 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:17.004786 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e04634-00da-443d-a322-14edee695ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:17.005321 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e04634-00da-443d-a322-14edee695ec8 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:17.005596 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e04634-00da-443d-a322-14edee695ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:17.005866 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e04634-00da-443d-a322-14edee695ec8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:17.080328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e04634-00da-443d-a322-14edee695ec8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:17.081815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e04634-00da-443d-a322-14edee695ec8 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:17.179603 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:17.196322 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 145/292] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:17.200069 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9933d6-b5f5-47cd-af80-2fbc209bde79 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:17.309757 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9933d6-b5f5-47cd-af80-2fbc209bde79 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:17.347711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c996cc-f974-4d32-bb4e-db11bdc172e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:17.348692 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c996cc-f974-4d32-bb4e-db11bdc172e0 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:17.349119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c996cc-f974-4d32-bb4e-db11bdc172e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:17.349536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c996cc-f974-4d32-bb4e-db11bdc172e0 None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:17.350874 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c996cc-f974-4d32-bb4e-db11bdc172e0 None admin] RBAC: Authorizing `identity:get_project(project_id=35715c28855e4d0b93c644f5a3804760)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:17.352450 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c996cc-f974-4d32-bb4e-db11bdc172e0 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:17.358654 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 148/293] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:17 2022] GET /identity/v3/projects/35715c28855e4d0b93c644f5a3804760 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:17.360752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e04634-00da-443d-a322-14edee695ec8 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:17.465952 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e04634-00da-443d-a322-14edee695ec8 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:17.501913 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f1c2d-010a-4c2a-91b1-fa249844841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:17.502919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f1c2d-010a-4c2a-91b1-fa249844841a None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:17.503333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f1c2d-010a-4c2a-91b1-fa249844841a None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:17.503762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f1c2d-010a-4c2a-91b1-fa249844841a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:17.504612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f1c2d-010a-4c2a-91b1-fa249844841a None admin] RBAC: Adding query filter params (role.id=83a904d35afc48fe9f8d55c0fd1597d8, scope.project.id=35715c28855e4d0b93c644f5a3804760, user.id=3f2360e322624305b7c2ca03e805b9a8) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:17.505083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f1c2d-010a-4c2a-91b1-fa249844841a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:17.506658 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f1c2d-010a-4c2a-91b1-fa249844841a None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:17.517294 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 146/294] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:12:17 2022] GET /identity/v3/role_assignments?user.id=3f2360e322624305b7c2ca03e805b9a8&scope.project.id=35715c28855e4d0b93c644f5a3804760&role.id=83a904d35afc48fe9f8d55c0fd1597d8 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:18.464891 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c4f92-4d1d-499a-9df8-f1ac4dcc310f None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:18.465906 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c4f92-4d1d-499a-9df8-f1ac4dcc310f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:18.466379 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c4f92-4d1d-499a-9df8-f1ac4dcc310f None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:18.468267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 149/295] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:18.473375 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b201f8-8ca2-4469-8701-899642b3f762 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:18.473819 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b201f8-8ca2-4469-8701-899642b3f762 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:18.474010 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b201f8-8ca2-4469-8701-899642b3f762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:18.492691 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-42b201f8-8ca2-4469-8701-899642b3f762 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:18.494513 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-42b201f8-8ca2-4469-8701-899642b3f762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:18.546828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:18.574749 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 147/296] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:18.875916 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb2894-6e39-414f-b1c2-fcbde552e1cb None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:18.876641 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb2894-6e39-414f-b1c2-fcbde552e1cb None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:18.877121 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb2894-6e39-414f-b1c2-fcbde552e1cb None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:18.879045 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 150/297] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:18.885314 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3d995-72e0-4af0-9668-2ea516c4987c None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:18.885650 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3d995-72e0-4af0-9668-2ea516c4987c None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:18.886049 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3d995-72e0-4af0-9668-2ea516c4987c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:18.905075 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-8ce3d995-72e0-4af0-9668-2ea516c4987c None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:18.906284 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-8ce3d995-72e0-4af0-9668-2ea516c4987c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:18.911596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb2894-6e39-414f-b1c2-fcbde552e1cb None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:18.959794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:18.992404 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 148/298] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:19.001557 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e2cf9-10ff-497c-a5f0-216df2bedf48 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:19.001842 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e2cf9-10ff-497c-a5f0-216df2bedf48 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:19.002116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e2cf9-10ff-497c-a5f0-216df2bedf48 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:19.003637 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 149/299] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:12:19.008595 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff919d26-1cb0-4c05-96b3-eb470cf135ea None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:19.008876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff919d26-1cb0-4c05-96b3-eb470cf135ea None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:19.009151 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff919d26-1cb0-4c05-96b3-eb470cf135ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:19.033212 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-ff919d26-1cb0-4c05-96b3-eb470cf135ea None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:19.034733 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-ff919d26-1cb0-4c05-96b3-eb470cf135ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:19.037352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb2894-6e39-414f-b1c2-fcbde552e1cb None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:19.079505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c9339-2c8e-417b-800e-0c5a62008fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:19.080660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c9339-2c8e-417b-800e-0c5a62008fd7 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:19.081154 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c9339-2c8e-417b-800e-0c5a62008fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:19.081617 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c9339-2c8e-417b-800e-0c5a62008fd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:19.083132 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c9339-2c8e-417b-800e-0c5a62008fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:19.084902 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c9339-2c8e-417b-800e-0c5a62008fd7 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:19.086711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 151/300] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:19.093460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c9339-2c8e-417b-800e-0c5a62008fd7 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:19.111831 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 150/301] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:12:19.205123 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c9339-2c8e-417b-800e-0c5a62008fd7 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:19.216781 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:19.241896 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51776d39-ea60-4bd9-940f-00705f1b3beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:19.246672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51776d39-ea60-4bd9-940f-00705f1b3beb None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:19.246672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51776d39-ea60-4bd9-940f-00705f1b3beb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:19.246672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51776d39-ea60-4bd9-940f-00705f1b3beb None admin] PATH_INFO: `/v3/groups` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:19.246672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51776d39-ea60-4bd9-940f-00705f1b3beb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:19.246672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51776d39-ea60-4bd9-940f-00705f1b3beb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:19.349646 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 152/302] 10.222.0.61 () {60 vars in 1134 bytes} [Fri Aug 19 19:12:19 2022] POST /identity/v3/groups => generated 229 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:12:19.357692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff919d26-1cb0-4c05-96b3-eb470cf135ea None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:19.406827 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:19.449599 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51776d39-ea60-4bd9-940f-00705f1b3beb None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:19.481662 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff919d26-1cb0-4c05-96b3-eb470cf135ea None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:19.536876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35443425-51c1-4803-96b1-fbc030b5b7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:19.537528 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35443425-51c1-4803-96b1-fbc030b5b7ae None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:19.537806 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35443425-51c1-4803-96b1-fbc030b5b7ae None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:19.538078 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35443425-51c1-4803-96b1-fbc030b5b7ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:19.553897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35443425-51c1-4803-96b1-fbc030b5b7ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:19.560191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-35443425-51c1-4803-96b1-fbc030b5b7ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:12:19.560191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:19.560191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:19.560191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:19.560191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:19.560191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:19.560191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:19.560191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:19.560191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:19.560191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:19.560191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:19.560191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:19.560191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:19.560191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:19.560191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:19.560191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:19.561092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:19.561092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:19.561092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:19.561092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:19.561092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:19.561092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:19.561092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:19.561092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:19.561092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:19.561092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:19.561092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:19.561092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:19.561092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:19.561092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:19.561092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:19.561092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:19.566984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:19.566984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:19.566984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:19.566984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:19.566984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:19.566984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:19.566984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:19.566984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:19.566984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:19.566984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:19.566984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:12:19.566984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:19.566984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 151/303] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:19.569385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35443425-51c1-4803-96b1-fbc030b5b7ae None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:19.588017 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51776d39-ea60-4bd9-940f-00705f1b3beb None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:19.630060 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7f95d-e114-489b-b099-edb77e9b068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:19.631404 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7f95d-e114-489b-b099-edb77e9b068b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:19.631943 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7f95d-e114-489b-b099-edb77e9b068b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:19.632422 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7f95d-e114-489b-b099-edb77e9b068b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:19.645846 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7f95d-e114-489b-b099-edb77e9b068b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:19.653342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-cce7f95d-e114-489b-b099-edb77e9b068b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:19.653342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:19.653342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:19.653342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:19.653342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:19.653342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:19.653342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:19.653342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:19.653342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:19.653342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:19.653342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:19.653342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:19.653342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:19.653342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:19.653342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:19.653342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:19.654230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:19.654230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:19.654230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:19.654230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:19.654230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:19.654230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:19.654230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:19.654230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:19.654230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:19.654230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:19.654230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:19.654230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:19.654230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:19.654230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:19.654230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:19.654230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:19.655156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:19.655156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:19.655156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:19.655156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:19.655156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:19.655156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:19.655156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:19.655156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:19.655156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:19.655156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:19.655156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:19.655156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:19.655156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 153/304] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:19.660788 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7f95d-e114-489b-b099-edb77e9b068b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:19.692086 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:19.693474 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:19.695772 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35443425-51c1-4803-96b1-fbc030b5b7ae None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:19.732139 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509447f-9eca-4468-adf6-77d4d174a7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:19.732670 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509447f-9eca-4468-adf6-77d4d174a7d9 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:19.732947 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509447f-9eca-4468-adf6-77d4d174a7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:19.733216 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509447f-9eca-4468-adf6-77d4d174a7d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:19.733878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509447f-9eca-4468-adf6-77d4d174a7d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:19.734229 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509447f-9eca-4468-adf6-77d4d174a7d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:19.735579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509447f-9eca-4468-adf6-77d4d174a7d9 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:19.745692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 152/305] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:19.747832 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1f4b9-c328-468f-93b7-f19b4d523a5d None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:19.748284 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1f4b9-c328-468f-93b7-f19b4d523a5d None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:19.748692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1f4b9-c328-468f-93b7-f19b4d523a5d None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:19.750877 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 153/306] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:19.751584 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1f4b9-c328-468f-93b7-f19b4d523a5d None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:19.770511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7f95d-e114-489b-b099-edb77e9b068b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:19.807154 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896597c9-8fa4-409d-b1eb-665604070076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:19.807870 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896597c9-8fa4-409d-b1eb-665604070076 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:19.808078 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896597c9-8fa4-409d-b1eb-665604070076 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:19.808342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896597c9-8fa4-409d-b1eb-665604070076 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:19.809046 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896597c9-8fa4-409d-b1eb-665604070076 None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:19.809340 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896597c9-8fa4-409d-b1eb-665604070076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:19.810734 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896597c9-8fa4-409d-b1eb-665604070076 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:19.824081 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 154/307] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:19.824081 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845c0b3-119b-41fa-82c4-0ee7f1cde438 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:19.824081 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845c0b3-119b-41fa-82c4-0ee7f1cde438 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:19.824081 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845c0b3-119b-41fa-82c4-0ee7f1cde438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:19.843875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-e845c0b3-119b-41fa-82c4-0ee7f1cde438 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:19.845121 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e845c0b3-119b-41fa-82c4-0ee7f1cde438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:19.871303 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1f4b9-c328-468f-93b7-f19b4d523a5d None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:19.907736 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095aee8-6ac0-4328-9d97-f48511ba85c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:19.908368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095aee8-6ac0-4328-9d97-f48511ba85c0 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:19.908648 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095aee8-6ac0-4328-9d97-f48511ba85c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:19.908918 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095aee8-6ac0-4328-9d97-f48511ba85c0 None admin] PATH_INFO: `/v3/users/a2193dd47c9f4bed8d384019235af4cb` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:19.926579 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 155/308] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:19.926579 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845c0b3-119b-41fa-82c4-0ee7f1cde438 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:19.936908 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095aee8-6ac0-4328-9d97-f48511ba85c0 None admin] RBAC: Authorizing `identity:get_user(user_id=a2193dd47c9f4bed8d384019235af4cb)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:19.939142 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095aee8-6ac0-4328-9d97-f48511ba85c0 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:19.942916 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 154/309] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:19 2022] GET /identity/v3/users/a2193dd47c9f4bed8d384019235af4cb => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:19.947641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095aee8-6ac0-4328-9d97-f48511ba85c0 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:19.949520 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:19.977319 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:20.066983 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845c0b3-119b-41fa-82c4-0ee7f1cde438 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:20.087982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095aee8-6ac0-4328-9d97-f48511ba85c0 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:20.126873 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af4773-4497-419e-9c90-ccbf6eb6a836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:20.128772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af4773-4497-419e-9c90-ccbf6eb6a836 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:20.129763 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af4773-4497-419e-9c90-ccbf6eb6a836 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:20.130441 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af4773-4497-419e-9c90-ccbf6eb6a836 None admin] PATH_INFO: `/v3/users/e9de3735f2e44acdb955df4c47cfa2cf` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:20.132603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af4773-4497-419e-9c90-ccbf6eb6a836 None admin] RBAC: Authorizing `identity:get_user(user_id=e9de3735f2e44acdb955df4c47cfa2cf)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:20.133289 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43258e-55f7-4060-b7c4-b398201cd9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:20.133885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43258e-55f7-4060-b7c4-b398201cd9e0 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:20.134159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43258e-55f7-4060-b7c4-b398201cd9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:20.134514 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43258e-55f7-4060-b7c4-b398201cd9e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:20.135343 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43258e-55f7-4060-b7c4-b398201cd9e0 None admin] RBAC: Adding query filter params (role.id=14b4522936a24e78a58d9f0dcae537be, user.id=a2193dd47c9f4bed8d384019235af4cb, scope.system=all) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:20.135650 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43258e-55f7-4060-b7c4-b398201cd9e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:20.136866 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af4773-4497-419e-9c90-ccbf6eb6a836 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:20.137061 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43258e-55f7-4060-b7c4-b398201cd9e0 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:20.141574 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 156/310] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:19 2022] GET /identity/v3/users/e9de3735f2e44acdb955df4c47cfa2cf => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:20.144842 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 155/311] 10.222.0.61 () {56 vars in 1308 bytes} [Fri Aug 19 19:12:19 2022] GET /identity/v3/role_assignments?user.id=a2193dd47c9f4bed8d384019235af4cb&scope.system=all&role.id=14b4522936a24e78a58d9f0dcae537be => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:20.150355 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af4773-4497-419e-9c90-ccbf6eb6a836 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:20.313938 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:20.331395 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af4773-4497-419e-9c90-ccbf6eb6a836 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:20.386044 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0bf03-6595-4df7-9868-15fb63470f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:20.386723 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0bf03-6595-4df7-9868-15fb63470f1f None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:20.387000 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0bf03-6595-4df7-9868-15fb63470f1f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:20.387326 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0bf03-6595-4df7-9868-15fb63470f1f None admin] PATH_INFO: `/v3/system/users/e9de3735f2e44acdb955df4c47cfa2cf/roles/83a904d35afc48fe9f8d55c0fd1597d8` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:20.388824 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0bf03-6595-4df7-9868-15fb63470f1f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e9de3735f2e44acdb955df4c47cfa2cf, role_id=83a904d35afc48fe9f8d55c0fd1597d8)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:20.390197 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0bf03-6595-4df7-9868-15fb63470f1f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:20.412240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43258e-55f7-4060-b7c4-b398201cd9e0 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:20.470190 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 157/312] 10.222.0.61 () {58 vars in 1334 bytes} [Fri Aug 19 19:12:20 2022] PUT /identity/v3/system/users/e9de3735f2e44acdb955df4c47cfa2cf/roles/83a904d35afc48fe9f8d55c0fd1597d8 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:12:20.515043 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:20.533809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43258e-55f7-4060-b7c4-b398201cd9e0 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:20.577222 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc349098-de86-4f45-9c3e-9aee49e7636b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:20.577889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc349098-de86-4f45-9c3e-9aee49e7636b None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:20.578167 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc349098-de86-4f45-9c3e-9aee49e7636b None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:20.578439 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc349098-de86-4f45-9c3e-9aee49e7636b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:20.591879 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc349098-de86-4f45-9c3e-9aee49e7636b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:20.596920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-dc349098-de86-4f45-9c3e-9aee49e7636b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:12:20.596920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:20.596920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:20.596920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:20.596920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:20.596920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:20.596920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:20.596920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:20.596920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:20.596920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:20.596920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:20.596920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:20.596920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:20.596920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:20.596920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:20.596920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:20.597809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:20.597809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:20.597809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:20.597809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:20.597809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:20.597809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:20.597809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:20.597809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:20.597809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:20.597809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:20.597809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:20.597809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:20.597809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:20.597809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:20.597809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:20.597809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:20.599310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:20.599310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:20.599310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:20.599310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:20.599310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:20.599310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:20.599310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:20.599310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:20.599310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:20.599310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:20.599310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:12:20.599310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:20.599310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 156/313] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:20.607997 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0bf03-6595-4df7-9868-15fb63470f1f None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:20.730329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0bf03-6595-4df7-9868-15fb63470f1f None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:20.765788 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc3d25-4733-408a-91a3-270d1fae7ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:20.766780 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc3d25-4733-408a-91a3-270d1fae7ba0 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:20.767256 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc3d25-4733-408a-91a3-270d1fae7ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:20.767718 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc3d25-4733-408a-91a3-270d1fae7ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:20.768572 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc3d25-4733-408a-91a3-270d1fae7ba0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:20.769089 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc3d25-4733-408a-91a3-270d1fae7ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:20.770692 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc3d25-4733-408a-91a3-270d1fae7ba0 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:20.779702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 158/314] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:20.785015 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc349098-de86-4f45-9c3e-9aee49e7636b None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:20.893280 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc349098-de86-4f45-9c3e-9aee49e7636b None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:20.928098 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf4e99-067d-4834-9879-15e4b1bfc895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:20.928726 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf4e99-067d-4834-9879-15e4b1bfc895 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:20.929001 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf4e99-067d-4834-9879-15e4b1bfc895 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:20.929269 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf4e99-067d-4834-9879-15e4b1bfc895 None admin] PATH_INFO: `/v3/users/818b66215ece41abbe7033e517f8b835` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:20.930441 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf4e99-067d-4834-9879-15e4b1bfc895 None admin] RBAC: Authorizing `identity:get_user(user_id=818b66215ece41abbe7033e517f8b835)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:20.932018 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf4e99-067d-4834-9879-15e4b1bfc895 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:20.933841 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 157/315] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:20 2022] GET /identity/v3/users/818b66215ece41abbe7033e517f8b835 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:20.939167 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc3d25-4733-408a-91a3-270d1fae7ba0 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:20.958789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:21.044777 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc3d25-4733-408a-91a3-270d1fae7ba0 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:21.079589 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edec93-aaa7-438e-ac8f-c77bd776b80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:21.080176 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edec93-aaa7-438e-ac8f-c77bd776b80b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:21.080442 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edec93-aaa7-438e-ac8f-c77bd776b80b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:21.080712 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edec93-aaa7-438e-ac8f-c77bd776b80b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:21.154626 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02edec93-aaa7-438e-ac8f-c77bd776b80b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:21.156099 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02edec93-aaa7-438e-ac8f-c77bd776b80b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:21.174096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:21.262379 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 159/316] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:21.269660 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf4e99-067d-4834-9879-15e4b1bfc895 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:21.286302 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:21.378797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf4e99-067d-4834-9879-15e4b1bfc895 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:21.414631 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e328563-4f0f-4775-840a-0b5ea45cd810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:21.415193 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e328563-4f0f-4775-840a-0b5ea45cd810 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:21.415471 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e328563-4f0f-4775-840a-0b5ea45cd810 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:21.416470 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e328563-4f0f-4775-840a-0b5ea45cd810 None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:21.417619 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e328563-4f0f-4775-840a-0b5ea45cd810 None admin] RBAC: Authorizing `identity:get_project(project_id=35715c28855e4d0b93c644f5a3804760)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:21.419091 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e328563-4f0f-4775-840a-0b5ea45cd810 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:21.421144 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 158/317] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:21 2022] GET /identity/v3/projects/35715c28855e4d0b93c644f5a3804760 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:21.426950 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edec93-aaa7-438e-ac8f-c77bd776b80b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:21.527519 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edec93-aaa7-438e-ac8f-c77bd776b80b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:21.547104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:21.566950 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d8698-ea5d-43c9-9114-42255bd6a2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:21.567572 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d8698-ea5d-43c9-9114-42255bd6a2cb None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:21.567846 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d8698-ea5d-43c9-9114-42255bd6a2cb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:21.568113 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d8698-ea5d-43c9-9114-42255bd6a2cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:21.568843 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d8698-ea5d-43c9-9114-42255bd6a2cb None admin] RBAC: Adding query filter params (role.id=14b4522936a24e78a58d9f0dcae537be, scope.project.id=35715c28855e4d0b93c644f5a3804760, user.id=818b66215ece41abbe7033e517f8b835) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:21.569173 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d8698-ea5d-43c9-9114-42255bd6a2cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:21.570643 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d8698-ea5d-43c9-9114-42255bd6a2cb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:21.578070 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 160/318] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:12:21 2022] GET /identity/v3/role_assignments?user.id=818b66215ece41abbe7033e517f8b835&scope.project.id=35715c28855e4d0b93c644f5a3804760&role.id=14b4522936a24e78a58d9f0dcae537be => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:21.720880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48905354-8bb3-4011-8acb-893cc12e5a2d None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:21.721462 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48905354-8bb3-4011-8acb-893cc12e5a2d None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:21.721462 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48905354-8bb3-4011-8acb-893cc12e5a2d None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:21.722982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 159/319] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:21.729224 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b9ce9-c23d-409c-a313-3a817519e0e9 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:21.729800 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b9ce9-c23d-409c-a313-3a817519e0e9 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:21.729915 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b9ce9-c23d-409c-a313-3a817519e0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:21.749643 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-e22b9ce9-c23d-409c-a313-3a817519e0e9 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:21.750895 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e22b9ce9-c23d-409c-a313-3a817519e0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:21.824048 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 161/320] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:22.148988 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48905354-8bb3-4011-8acb-893cc12e5a2d None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:22.235573 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:22.255309 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48905354-8bb3-4011-8acb-893cc12e5a2d None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:22.292275 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f647e46-d44c-4d5b-a6e2-cd07ddec8692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:22.293291 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f647e46-d44c-4d5b-a6e2-cd07ddec8692 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:22.293819 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f647e46-d44c-4d5b-a6e2-cd07ddec8692 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:22.294293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f647e46-d44c-4d5b-a6e2-cd07ddec8692 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:22.295688 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f647e46-d44c-4d5b-a6e2-cd07ddec8692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:22.297514 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f647e46-d44c-4d5b-a6e2-cd07ddec8692 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:22.299513 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 160/321] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:22.305206 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b9ce9-c23d-409c-a313-3a817519e0e9 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:22.415521 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b9ce9-c23d-409c-a313-3a817519e0e9 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:22.426748 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:22.451298 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005984e8-480e-4656-8b2b-5025413a7b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:22.452130 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005984e8-480e-4656-8b2b-5025413a7b10 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:22.452556 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005984e8-480e-4656-8b2b-5025413a7b10 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:22.452971 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005984e8-480e-4656-8b2b-5025413a7b10 None admin] PATH_INFO: `/v3/groups` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:22.453766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005984e8-480e-4656-8b2b-5025413a7b10 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:22.455385 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005984e8-480e-4656-8b2b-5025413a7b10 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:22.484648 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d63aa-7669-4d06-91ab-b906dc3b3791 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:22.484933 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d63aa-7669-4d06-91ab-b906dc3b3791 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:22.485209 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d63aa-7669-4d06-91ab-b906dc3b3791 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:22.486616 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 161/322] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:12:22.491489 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1631a8-f5cb-4644-9fae-a30804afcaed None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:22.491771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1631a8-f5cb-4644-9fae-a30804afcaed None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:22.492049 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1631a8-f5cb-4644-9fae-a30804afcaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:22.510970 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-0b1631a8-f5cb-4644-9fae-a30804afcaed None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:22.512166 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-0b1631a8-f5cb-4644-9fae-a30804afcaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:22.566602 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 162/323] 10.222.0.61 () {60 vars in 1134 bytes} [Fri Aug 19 19:12:22 2022] POST /identity/v3/groups => generated 226 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:12:22.590665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 162/324] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:12:22.834101 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d0c3c-1e89-4e96-9e5e-bc0a473b8bb0 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:22.834645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d0c3c-1e89-4e96-9e5e-bc0a473b8bb0 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:22.834962 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d0c3c-1e89-4e96-9e5e-bc0a473b8bb0 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:22.836525 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 163/325] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:22.842889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b643811-db13-445c-8dd7-4fb319c3bdc6 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:22.843741 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b643811-db13-445c-8dd7-4fb319c3bdc6 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:22.844202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b643811-db13-445c-8dd7-4fb319c3bdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:22.865342 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-0b643811-db13-445c-8dd7-4fb319c3bdc6 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:22.866554 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-0b643811-db13-445c-8dd7-4fb319c3bdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:22.927835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d0c3c-1e89-4e96-9e5e-bc0a473b8bb0 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:22.945633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 163/326] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:12:23.053716 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d0c3c-1e89-4e96-9e5e-bc0a473b8bb0 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:23.090220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1d609-8211-463d-ac53-43c6a58da41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:23.090811 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1d609-8211-463d-ac53-43c6a58da41b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:23.091087 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1d609-8211-463d-ac53-43c6a58da41b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:23.091359 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1d609-8211-463d-ac53-43c6a58da41b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:23.104532 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1d609-8211-463d-ac53-43c6a58da41b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:23.109861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-08d1d609-8211-463d-ac53-43c6a58da41b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:12:23.109861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:23.109861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:23.109861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:23.109861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:23.109861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:23.109861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:23.109861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:23.109861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:23.109861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:23.109861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:23.109861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:23.109861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:23.109861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:23.109861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:23.109861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:23.110808 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:23.110808 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:23.110808 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:23.110808 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:23.110808 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:23.110808 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:23.110808 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:23.110808 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:23.110808 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:23.110808 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:23.110808 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:23.110808 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:23.110808 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:23.110808 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:23.110808 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:23.110808 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:23.111580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:23.111580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:23.111580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:23.111580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:23.111580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:23.111580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:23.111580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:23.111580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:23.111580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:23.111580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:23.111580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:12:23.111580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:23.114614 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 164/327] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:23.117133 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b643811-db13-445c-8dd7-4fb319c3bdc6 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:23.128894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:23.238885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b643811-db13-445c-8dd7-4fb319c3bdc6 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:23.274581 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e7754-1f4b-4cc2-94ef-d828f6a4d6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:23.275263 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e7754-1f4b-4cc2-94ef-d828f6a4d6e6 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:23.275639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e7754-1f4b-4cc2-94ef-d828f6a4d6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:23.275916 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e7754-1f4b-4cc2-94ef-d828f6a4d6e6 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:23.276584 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e7754-1f4b-4cc2-94ef-d828f6a4d6e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:23.276885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e7754-1f4b-4cc2-94ef-d828f6a4d6e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:23.278256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e7754-1f4b-4cc2-94ef-d828f6a4d6e6 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:23.287132 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 164/328] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:23.293336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1d609-8211-463d-ac53-43c6a58da41b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:23.294499 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e7754-1f4b-4cc2-94ef-d828f6a4d6e6 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:23.344526 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:23.380217 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:23.428452 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e7754-1f4b-4cc2-94ef-d828f6a4d6e6 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:23.448630 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1d609-8211-463d-ac53-43c6a58da41b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:23.479078 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3f1f4-0a02-4dc7-954d-4bbad7e0df0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:23.479979 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3f1f4-0a02-4dc7-954d-4bbad7e0df0a None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:23.480710 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3f1f4-0a02-4dc7-954d-4bbad7e0df0a None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:23.480985 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3f1f4-0a02-4dc7-954d-4bbad7e0df0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:23.495772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afe23b-c49d-4ef6-a570-46718969e310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:23.496485 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afe23b-c49d-4ef6-a570-46718969e310 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:23.496765 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afe23b-c49d-4ef6-a570-46718969e310 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:23.497035 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afe23b-c49d-4ef6-a570-46718969e310 None admin] PATH_INFO: `/v3/users/a2193dd47c9f4bed8d384019235af4cb` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:23.498433 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afe23b-c49d-4ef6-a570-46718969e310 None admin] RBAC: Authorizing `identity:get_user(user_id=a2193dd47c9f4bed8d384019235af4cb)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:23.499922 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afe23b-c49d-4ef6-a570-46718969e310 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:23.501728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 165/329] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:23 2022] GET /identity/v3/users/a2193dd47c9f4bed8d384019235af4cb => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:23.505251 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3f1f4-0a02-4dc7-954d-4bbad7e0df0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:23.507729 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afe23b-c49d-4ef6-a570-46718969e310 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:23.512878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-25e3f1f4-0a02-4dc7-954d-4bbad7e0df0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:23.512878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:23.512878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:23.512878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:23.512878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:23.512878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:23.512878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:23.512878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:23.512878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:23.512878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:23.512878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:23.512878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:23.512878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:23.512878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:23.512878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:23.512878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:23.517957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:23.517957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:23.517957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:23.517957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:23.517957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:23.517957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:23.517957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:23.517957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:23.517957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:23.517957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:23.517957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:23.517957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:23.517957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:23.517957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:23.517957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:23.517957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:23.518820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:23.518820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:23.518820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:23.518820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:23.518820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:23.518820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:23.518820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:23.518820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:23.518820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:23.518820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:23.518820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:23.518820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:23.518820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 165/330] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:23.526544 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3f1f4-0a02-4dc7-954d-4bbad7e0df0a None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:23.639060 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:23.643902 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afe23b-c49d-4ef6-a570-46718969e310 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:23.661656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3f1f4-0a02-4dc7-954d-4bbad7e0df0a None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:23.682962 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae5e47-9db8-42bd-9f1a-3d1681a15ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:23.683990 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae5e47-9db8-42bd-9f1a-3d1681a15ffb None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:23.684407 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae5e47-9db8-42bd-9f1a-3d1681a15ffb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:23.684831 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae5e47-9db8-42bd-9f1a-3d1681a15ffb None admin] PATH_INFO: `/v3/system/users/a2193dd47c9f4bed8d384019235af4cb/roles/14b4522936a24e78a58d9f0dcae537be` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:23.686410 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae5e47-9db8-42bd-9f1a-3d1681a15ffb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a2193dd47c9f4bed8d384019235af4cb, role_id=14b4522936a24e78a58d9f0dcae537be)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:23.688127 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae5e47-9db8-42bd-9f1a-3d1681a15ffb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:23.693057 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:23.702588 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a50328-93cf-4e4d-b0eb-fd151ac13626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:23.706711 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a50328-93cf-4e4d-b0eb-fd151ac13626 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:23.706711 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a50328-93cf-4e4d-b0eb-fd151ac13626 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:23.706711 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a50328-93cf-4e4d-b0eb-fd151ac13626 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:23.706711 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a50328-93cf-4e4d-b0eb-fd151ac13626 None admin] RBAC: Adding query filter params (name=member) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:23.706711 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a50328-93cf-4e4d-b0eb-fd151ac13626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:23.706711 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a50328-93cf-4e4d-b0eb-fd151ac13626 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:23.717065 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 166/331] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:23.722998 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a50328-93cf-4e4d-b0eb-fd151ac13626 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:23.764788 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 166/332] 10.222.0.61 () {58 vars in 1334 bytes} [Fri Aug 19 19:12:23 2022] PUT /identity/v3/system/users/a2193dd47c9f4bed8d384019235af4cb/roles/14b4522936a24e78a58d9f0dcae537be => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 19:12:23.848636 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a50328-93cf-4e4d-b0eb-fd151ac13626 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:23.888483 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f78866-3776-43a5-9d7a-bb3c448f55e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:23.889198 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f78866-3776-43a5-9d7a-bb3c448f55e2 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:23.889413 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f78866-3776-43a5-9d7a-bb3c448f55e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:23.889682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f78866-3776-43a5-9d7a-bb3c448f55e2 None admin] PATH_INFO: `/v3/users/e9de3735f2e44acdb955df4c47cfa2cf` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:23.890933 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f78866-3776-43a5-9d7a-bb3c448f55e2 None admin] RBAC: Authorizing `identity:get_user(user_id=e9de3735f2e44acdb955df4c47cfa2cf)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:23.892408 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f78866-3776-43a5-9d7a-bb3c448f55e2 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:23.894482 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 167/333] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:23 2022] GET /identity/v3/users/e9de3735f2e44acdb955df4c47cfa2cf => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:23.900663 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae5e47-9db8-42bd-9f1a-3d1681a15ffb None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:24.023517 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae5e47-9db8-42bd-9f1a-3d1681a15ffb None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:24.065237 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8de12e-c4ad-479a-8ef9-081a39951e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:24.065867 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8de12e-c4ad-479a-8ef9-081a39951e20 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:24.066143 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8de12e-c4ad-479a-8ef9-081a39951e20 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:24.066703 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8de12e-c4ad-479a-8ef9-081a39951e20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:24.067434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8de12e-c4ad-479a-8ef9-081a39951e20 None admin] RBAC: Adding query filter params (role.id=83a904d35afc48fe9f8d55c0fd1597d8, user.id=e9de3735f2e44acdb955df4c47cfa2cf, scope.system=all) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:24.067741 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8de12e-c4ad-479a-8ef9-081a39951e20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:24.069205 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8de12e-c4ad-479a-8ef9-081a39951e20 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:24.084064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 167/334] 10.222.0.61 () {56 vars in 1308 bytes} [Fri Aug 19 19:12:23 2022] GET /identity/v3/role_assignments?user.id=e9de3735f2e44acdb955df4c47cfa2cf&scope.system=all&role.id=83a904d35afc48fe9f8d55c0fd1597d8 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:25.497317 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46b3c9-dbfd-44e9-a7dd-80f2e69b3852 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:25.497819 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46b3c9-dbfd-44e9-a7dd-80f2e69b3852 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:25.497925 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46b3c9-dbfd-44e9-a7dd-80f2e69b3852 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:25.499516 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 168/335] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:25.504482 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdb1d2-d371-4d04-8dae-66d9b7d96e27 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:25.504902 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdb1d2-d371-4d04-8dae-66d9b7d96e27 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:25.505070 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdb1d2-d371-4d04-8dae-66d9b7d96e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:25.528903 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-4dbdb1d2-d371-4d04-8dae-66d9b7d96e27 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:25.530101 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4dbdb1d2-d371-4d04-8dae-66d9b7d96e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:25.549387 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:25.632961 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 168/336] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:26.266392 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a30260-cdf8-4837-87fd-ee341781843d None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:26.266808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a30260-cdf8-4837-87fd-ee341781843d None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:26.267001 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a30260-cdf8-4837-87fd-ee341781843d None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:26.268562 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 169/337] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:26.273997 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c9145-9f25-4737-9ecc-ea867cb66878 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:26.274281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c9145-9f25-4737-9ecc-ea867cb66878 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:26.274577 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c9145-9f25-4737-9ecc-ea867cb66878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:26.293850 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a52c9145-9f25-4737-9ecc-ea867cb66878 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:26.295213 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a52c9145-9f25-4737-9ecc-ea867cb66878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:26.305615 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a30260-cdf8-4837-87fd-ee341781843d None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:26.422120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:26.425370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 169/338] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:26.475738 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a30260-cdf8-4837-87fd-ee341781843d None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:26.523133 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602875c4-c8ca-49e0-9d0d-bbc43c49ec7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:26.523718 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602875c4-c8ca-49e0-9d0d-bbc43c49ec7c None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:26.523947 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602875c4-c8ca-49e0-9d0d-bbc43c49ec7c None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:26.524206 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602875c4-c8ca-49e0-9d0d-bbc43c49ec7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:26.542745 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602875c4-c8ca-49e0-9d0d-bbc43c49ec7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:26.547892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-602875c4-c8ca-49e0-9d0d-bbc43c49ec7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:26.547892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:26.547892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:26.547892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:26.547892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:26.547892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:26.547892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:26.547892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:26.547892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:26.547892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:26.547892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:26.547892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:26.547892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:26.547892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:26.547892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:26.547892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:26.551612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:26.551612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:26.551612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:26.551612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:26.551612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:26.551612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:26.551612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:26.551612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:26.551612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:26.551612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:26.551612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:26.551612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:26.551612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:26.551612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:26.551612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:26.551612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:26.552386 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:26.552386 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:26.552386 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:26.552386 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:26.552386 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:26.552386 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:26.552386 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:26.552386 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:26.552386 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:26.552386 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:26.552386 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:26.552386 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:26.555247 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 170/339] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:12:26.563349 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c9145-9f25-4737-9ecc-ea867cb66878 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:26.603355 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60f6c1-0b72-4319-98ba-923b3af7a1b3 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:26.603682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60f6c1-0b72-4319-98ba-923b3af7a1b3 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:26.603968 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60f6c1-0b72-4319-98ba-923b3af7a1b3 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:26.605567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 171/340] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:12:26.610607 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6857ef-368c-435a-8582-fcc2af50ce56 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:26.610893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6857ef-368c-435a-8582-fcc2af50ce56 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:26.611170 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6857ef-368c-435a-8582-fcc2af50ce56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:26.632635 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-ed6857ef-368c-435a-8582-fcc2af50ce56 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:26.633822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-ed6857ef-368c-435a-8582-fcc2af50ce56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:26.721336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:26.760742 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c9145-9f25-4737-9ecc-ea867cb66878 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:26.776009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 172/341] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:12:26.777302 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ba96f-0831-4f70-b328-d615c4709d02 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:26.777590 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ba96f-0831-4f70-b328-d615c4709d02 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:26.777867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ba96f-0831-4f70-b328-d615c4709d02 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:26.781585 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 173/342] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:26.787388 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f134e81-1629-4aad-9aaa-16f5907fbe7b None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:26.787665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f134e81-1629-4aad-9aaa-16f5907fbe7b None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:26.787945 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f134e81-1629-4aad-9aaa-16f5907fbe7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:26.830497 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-9f134e81-1629-4aad-9aaa-16f5907fbe7b None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:26.831725 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-9f134e81-1629-4aad-9aaa-16f5907fbe7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:26.841616 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db769223-7352-4f82-bf32-fba995c1a89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:26.842238 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db769223-7352-4f82-bf32-fba995c1a89c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:26.842514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db769223-7352-4f82-bf32-fba995c1a89c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:26.842809 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db769223-7352-4f82-bf32-fba995c1a89c None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:26.843471 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db769223-7352-4f82-bf32-fba995c1a89c None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:26.843776 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db769223-7352-4f82-bf32-fba995c1a89c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:26.845141 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db769223-7352-4f82-bf32-fba995c1a89c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:26.864478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 170/343] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:26.874417 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db769223-7352-4f82-bf32-fba995c1a89c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:26.963881 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:27.004870 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 174/344] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:27.005806 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f134e81-1629-4aad-9aaa-16f5907fbe7b None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:27.046262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db769223-7352-4f82-bf32-fba995c1a89c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:27.111272 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea44ed-ee80-4d10-b5c0-a95acaa6da3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:27.111888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea44ed-ee80-4d10-b5c0-a95acaa6da3a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:27.112165 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea44ed-ee80-4d10-b5c0-a95acaa6da3a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:27.112434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea44ed-ee80-4d10-b5c0-a95acaa6da3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:27.130923 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:27.198658 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f134e81-1629-4aad-9aaa-16f5907fbe7b None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:27.236033 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea44ed-ee80-4d10-b5c0-a95acaa6da3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:27.237508 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea44ed-ee80-4d10-b5c0-a95acaa6da3a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:27.272623 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4bb56-0443-41aa-a07c-9531d9a10170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:27.273271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4bb56-0443-41aa-a07c-9531d9a10170 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:27.273554 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4bb56-0443-41aa-a07c-9531d9a10170 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:27.273829 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4bb56-0443-41aa-a07c-9531d9a10170 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:27.295557 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4bb56-0443-41aa-a07c-9531d9a10170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:27.300580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-33f4bb56-0443-41aa-a07c-9531d9a10170 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:12:27.300580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:27.300580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:27.300580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:27.300580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:27.300580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:27.300580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:27.300580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:27.300580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:27.300580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:27.300580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:27.300580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:27.300580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:27.300580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:27.300580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:27.300580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:27.301432 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:27.301432 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:27.301432 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:27.301432 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:27.301432 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:27.301432 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:27.301432 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:27.301432 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:27.301432 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:27.301432 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:27.301432 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:27.301432 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:27.301432 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:27.301432 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:27.301432 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:27.301432 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:27.302206 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:27.302206 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:27.302206 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:27.302206 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:27.302206 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:27.302206 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:27.302206 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:27.302206 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:27.302206 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:27.302206 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:27.302206 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:12:27.302206 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:27.302206 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 175/345] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:12:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:27.302901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4bb56-0443-41aa-a07c-9531d9a10170 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:27.381269 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:27.398862 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 171/346] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 19:12:27.401056 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea44ed-ee80-4d10-b5c0-a95acaa6da3a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:27.452122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4bb56-0443-41aa-a07c-9531d9a10170 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:27.469645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:27.500932 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37038f0-1b65-407b-b74a-a1d54f737f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:27.502029 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37038f0-1b65-407b-b74a-a1d54f737f85 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:27.502586 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37038f0-1b65-407b-b74a-a1d54f737f85 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:27.503050 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37038f0-1b65-407b-b74a-a1d54f737f85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:27.515737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37038f0-1b65-407b-b74a-a1d54f737f85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:27.520890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-b37038f0-1b65-407b-b74a-a1d54f737f85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:27.520890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:27.520890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:27.520890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:27.520890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:27.520890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:27.520890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:27.520890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:27.520890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:27.520890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:27.520890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:27.520890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:27.520890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:27.520890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:27.520890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:27.520890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:27.521769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:27.521769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:27.521769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:27.521769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:27.521769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:27.521769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:27.521769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:27.521769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:27.521769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:27.521769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:27.521769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:27.521769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:27.521769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:27.521769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:27.521769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:27.521769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:27.522705 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:27.522705 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:27.522705 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:27.522705 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:27.522705 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:27.522705 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:27.522705 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:27.522705 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:27.522705 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:27.522705 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:27.522705 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:27.522705 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:27.525577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 176/347] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:27.526881 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37038f0-1b65-407b-b74a-a1d54f737f85 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:27.558077 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea44ed-ee80-4d10-b5c0-a95acaa6da3a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:27.599090 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adaf87-5ee2-4655-82d3-ca446e2aa288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:27.599781 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adaf87-5ee2-4655-82d3-ca446e2aa288 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:27.600007 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adaf87-5ee2-4655-82d3-ca446e2aa288 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:27.600254 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adaf87-5ee2-4655-82d3-ca446e2aa288 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:27.601056 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adaf87-5ee2-4655-82d3-ca446e2aa288 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:27.601223 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adaf87-5ee2-4655-82d3-ca446e2aa288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:27.602618 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adaf87-5ee2-4655-82d3-ca446e2aa288 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:27.611772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 172/348] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:12:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:27.612618 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adaf87-5ee2-4655-82d3-ca446e2aa288 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:27.644619 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37038f0-1b65-407b-b74a-a1d54f737f85 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:27.656798 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:27.684258 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22201fde-83f8-4b16-a51c-78df2063db4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:27.685092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22201fde-83f8-4b16-a51c-78df2063db4d None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:27.685469 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22201fde-83f8-4b16-a51c-78df2063db4d None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:27.685742 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22201fde-83f8-4b16-a51c-78df2063db4d None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:27.686991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22201fde-83f8-4b16-a51c-78df2063db4d None admin] RBAC: Authorizing `identity:get_project(project_id=91bbd1bb0efc40338fac7e525cc596d1)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:27.688612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22201fde-83f8-4b16-a51c-78df2063db4d None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:27.690272 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 177/349] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:27 2022] GET /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:27.691072 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22201fde-83f8-4b16-a51c-78df2063db4d None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:27.731692 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adaf87-5ee2-4655-82d3-ca446e2aa288 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:27.741414 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:27.783694 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f2c65-f1ff-4362-9e04-e6c8d131be2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:27.785293 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f2c65-f1ff-4362-9e04-e6c8d131be2c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:27.786034 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f2c65-f1ff-4362-9e04-e6c8d131be2c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:27.786404 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f2c65-f1ff-4362-9e04-e6c8d131be2c None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:27.787201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f2c65-f1ff-4362-9e04-e6c8d131be2c None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:27.787616 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f2c65-f1ff-4362-9e04-e6c8d131be2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:27.789190 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f2c65-f1ff-4362-9e04-e6c8d131be2c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:27.800159 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 173/350] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:27.801138 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f2c65-f1ff-4362-9e04-e6c8d131be2c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:27.810114 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22201fde-83f8-4b16-a51c-78df2063db4d None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:27.854108 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55494565-8cf6-4bfa-9259-daade5978616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:27.854776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55494565-8cf6-4bfa-9259-daade5978616 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:27.855050 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55494565-8cf6-4bfa-9259-daade5978616 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:27.855313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55494565-8cf6-4bfa-9259-daade5978616 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:27.871709 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55494565-8cf6-4bfa-9259-daade5978616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:27.877028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-55494565-8cf6-4bfa-9259-daade5978616 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:12:27.877028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:27.877028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:27.877028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:27.877028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:27.877028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:27.877028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:27.877028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:27.877028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:27.877028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:27.877028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:27.877028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:27.877028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:27.877028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:27.877028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:27.877028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:27.878088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:27.878088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:27.878088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:27.878088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:27.878088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:27.878088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:27.878088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:27.878088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:27.878088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:27.878088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:27.878088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:27.878088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:27.878088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:27.878088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:27.878088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:27.878088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:27.879040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:27.879040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:27.879040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:27.879040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:27.879040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:27.879040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:27.879040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:27.879040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:27.879040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:27.879040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:27.879040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 19:12:27.879040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:27.879040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 178/351] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:27.880670 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e3eee-e17e-437c-8442-8cbdda48ec2e None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:27.880949 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e3eee-e17e-437c-8442-8cbdda48ec2e None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:27.881223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e3eee-e17e-437c-8442-8cbdda48ec2e None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:27.882462 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 179/352] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:27.883212 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e3eee-e17e-437c-8442-8cbdda48ec2e None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:27.921856 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:27.931511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f2c65-f1ff-4362-9e04-e6c8d131be2c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:27.973969 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524966bd-b490-48aa-82bb-abaf31ab6be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:27.974624 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524966bd-b490-48aa-82bb-abaf31ab6be7 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:27.974946 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524966bd-b490-48aa-82bb-abaf31ab6be7 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:27.975330 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524966bd-b490-48aa-82bb-abaf31ab6be7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:28.019751 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:28.033813 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e3eee-e17e-437c-8442-8cbdda48ec2e None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:28.073789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524966bd-b490-48aa-82bb-abaf31ab6be7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:28.076192 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524966bd-b490-48aa-82bb-abaf31ab6be7 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:28.085232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e741a58-b1e7-4339-ba39-7e218d3bd000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:28.085911 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e741a58-b1e7-4339-ba39-7e218d3bd000 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:28.086188 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e741a58-b1e7-4339-ba39-7e218d3bd000 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:28.086458 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e741a58-b1e7-4339-ba39-7e218d3bd000 None admin] PATH_INFO: `/v3/groups/71314a20dde7428db3dd15076e1eae84` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:28.097086 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e741a58-b1e7-4339-ba39-7e218d3bd000 None admin] RBAC: Authorizing `identity:get_group(group_id=71314a20dde7428db3dd15076e1eae84)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:28.098679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e741a58-b1e7-4339-ba39-7e218d3bd000 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:28.101557 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 180/353] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Aug 19 19:12:27 2022] GET /identity/v3/groups/71314a20dde7428db3dd15076e1eae84 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:28.101557 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e741a58-b1e7-4339-ba39-7e218d3bd000 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:28.214567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 174/354] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:28.215398 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524966bd-b490-48aa-82bb-abaf31ab6be7 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:28.242568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:28.253538 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e741a58-b1e7-4339-ba39-7e218d3bd000 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:28.302453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9953d5-419c-4807-b823-007823c0f386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:28.303115 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9953d5-419c-4807-b823-007823c0f386 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:28.303660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:28.304361 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9953d5-419c-4807-b823-007823c0f386 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:28.304464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9953d5-419c-4807-b823-007823c0f386 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:28.347496 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524966bd-b490-48aa-82bb-abaf31ab6be7 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:28.385255 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99628340-45f3-448f-9db1-5943b6909e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:28.385990 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99628340-45f3-448f-9db1-5943b6909e4b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:28.386266 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99628340-45f3-448f-9db1-5943b6909e4b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:28.386545 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99628340-45f3-448f-9db1-5943b6909e4b None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:28.387244 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99628340-45f3-448f-9db1-5943b6909e4b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:28.387543 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99628340-45f3-448f-9db1-5943b6909e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:28.388917 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99628340-45f3-448f-9db1-5943b6909e4b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:28.395282 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9953d5-419c-4807-b823-007823c0f386 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:28.396769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9953d5-419c-4807-b823-007823c0f386 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:28.397708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 175/355] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:28.405450 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa1963-5a2a-4577-8343-fa8586ec1037 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:28.405450 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa1963-5a2a-4577-8343-fa8586ec1037 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:28.405450 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa1963-5a2a-4577-8343-fa8586ec1037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:28.421925 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-bdaa1963-5a2a-4577-8343-fa8586ec1037 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:28.423187 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-bdaa1963-5a2a-4577-8343-fa8586ec1037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:28.523357 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:28.530596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 176/356] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:28.530596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa1963-5a2a-4577-8343-fa8586ec1037 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:28.536140 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 181/357] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:28.537830 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9953d5-419c-4807-b823-007823c0f386 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:28.608643 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:28.661123 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa1963-5a2a-4577-8343-fa8586ec1037 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:28.669395 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9953d5-419c-4807-b823-007823c0f386 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:28.706169 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695d419-ab74-4327-94ee-67520e8d60bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:28.706819 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695d419-ab74-4327-94ee-67520e8d60bf None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:28.707096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695d419-ab74-4327-94ee-67520e8d60bf None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:28.707368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695d419-ab74-4327-94ee-67520e8d60bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:28.708096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695d419-ab74-4327-94ee-67520e8d60bf None admin] RBAC: Adding query filter params (group.id=71314a20dde7428db3dd15076e1eae84, role.id=83a904d35afc48fe9f8d55c0fd1597d8, scope.project.id=91bbd1bb0efc40338fac7e525cc596d1) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:28.708427 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695d419-ab74-4327-94ee-67520e8d60bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:28.710681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695d419-ab74-4327-94ee-67520e8d60bf None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:28.718558 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f2a91-2f78-48ef-b856-07ab09a0edc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:28.720365 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f2a91-2f78-48ef-b856-07ab09a0edc3 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:28.721028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f2a91-2f78-48ef-b856-07ab09a0edc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:28.721495 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f2a91-2f78-48ef-b856-07ab09a0edc3 None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:28.723753 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f2a91-2f78-48ef-b856-07ab09a0edc3 None admin] RBAC: Authorizing `identity:get_project(project_id=91bbd1bb0efc40338fac7e525cc596d1)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:28.725698 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 177/358] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Aug 19 19:12:28 2022] GET /identity/v3/role_assignments?group.id=71314a20dde7428db3dd15076e1eae84&scope.project.id=91bbd1bb0efc40338fac7e525cc596d1&role.id=83a904d35afc48fe9f8d55c0fd1597d8 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:28.726495 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f2a91-2f78-48ef-b856-07ab09a0edc3 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:28.726966 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695d419-ab74-4327-94ee-67520e8d60bf None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:28.732697 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 182/359] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:28 2022] GET /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:28.734456 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b53f51-d83a-41da-bccd-f02db487cecf None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:28.734954 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b53f51-d83a-41da-bccd-f02db487cecf None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:28.735207 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b53f51-d83a-41da-bccd-f02db487cecf None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:28.736553 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 183/360] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:28.737305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b53f51-d83a-41da-bccd-f02db487cecf None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:28.849573 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:28.879266 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695d419-ab74-4327-94ee-67520e8d60bf None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:28.904459 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b53f51-d83a-41da-bccd-f02db487cecf None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:28.909172 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:28.925633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff72d0d-23fe-4b30-87fe-b827b4b65a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:28.926298 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff72d0d-23fe-4b30-87fe-b827b4b65a98 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:28.926617 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff72d0d-23fe-4b30-87fe-b827b4b65a98 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:28.926900 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff72d0d-23fe-4b30-87fe-b827b4b65a98 None admin] PATH_INFO: `/v3/users/a2193dd47c9f4bed8d384019235af4cb` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:28.928703 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff72d0d-23fe-4b30-87fe-b827b4b65a98 None admin] RBAC: Authorizing `identity:get_user(user_id=a2193dd47c9f4bed8d384019235af4cb)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:28.930192 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff72d0d-23fe-4b30-87fe-b827b4b65a98 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:28.933284 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 178/361] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Aug 19 19:12:28 2022] GET /identity/v3/users/a2193dd47c9f4bed8d384019235af4cb => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:28.934149 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff72d0d-23fe-4b30-87fe-b827b4b65a98 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:28.948464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d4fdc-2493-48f1-905e-0343920a34e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:28.949108 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d4fdc-2493-48f1-905e-0343920a34e2 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:28.949380 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d4fdc-2493-48f1-905e-0343920a34e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:28.949642 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d4fdc-2493-48f1-905e-0343920a34e2 None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:28.950825 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d4fdc-2493-48f1-905e-0343920a34e2 None admin] RBAC: Authorizing `identity:get_project(project_id=35715c28855e4d0b93c644f5a3804760)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:28.952304 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d4fdc-2493-48f1-905e-0343920a34e2 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:28.954344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 184/362] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:28 2022] GET /identity/v3/projects/35715c28855e4d0b93c644f5a3804760 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:28.955596 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4b356-53e3-4ada-9428-e2d8b96d3f9c None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:28.955872 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4b356-53e3-4ada-9428-e2d8b96d3f9c None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:28.956142 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4b356-53e3-4ada-9428-e2d8b96d3f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:28.977005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-d1d4b356-53e3-4ada-9428-e2d8b96d3f9c None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:28.979307 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-d1d4b356-53e3-4ada-9428-e2d8b96d3f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:29.073599 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff72d0d-23fe-4b30-87fe-b827b4b65a98 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:29.074991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 185/363] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:29.076038 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4b356-53e3-4ada-9428-e2d8b96d3f9c None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:29.123612 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33136bcc-1355-4977-9fde-cabe9bc7d49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:29.124270 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33136bcc-1355-4977-9fde-cabe9bc7d49e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:29.124546 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33136bcc-1355-4977-9fde-cabe9bc7d49e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:29.124818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33136bcc-1355-4977-9fde-cabe9bc7d49e None admin] PATH_INFO: `/v3/groups/71314a20dde7428db3dd15076e1eae84` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:29.126442 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33136bcc-1355-4977-9fde-cabe9bc7d49e None admin] RBAC: Authorizing `identity:get_group(group_id=71314a20dde7428db3dd15076e1eae84)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:29.128509 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33136bcc-1355-4977-9fde-cabe9bc7d49e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:29.134744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 179/364] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Aug 19 19:12:28 2022] GET /identity/v3/groups/71314a20dde7428db3dd15076e1eae84 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:29.135657 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33136bcc-1355-4977-9fde-cabe9bc7d49e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:29.153914 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:29.213113 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4b356-53e3-4ada-9428-e2d8b96d3f9c None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:29.237107 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:29.252692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427af02-f40a-44b4-8ddc-d0d82427eba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:29.253325 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427af02-f40a-44b4-8ddc-d0d82427eba4 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:29.253597 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427af02-f40a-44b4-8ddc-d0d82427eba4 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:29.253863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427af02-f40a-44b4-8ddc-d0d82427eba4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:29.266405 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427af02-f40a-44b4-8ddc-d0d82427eba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:29.272359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-f427af02-f40a-44b4-8ddc-d0d82427eba4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:12:29.272359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:29.272359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:29.272359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:29.272359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:29.272359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:29.272359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:29.272359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:29.272359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:29.272359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:29.272359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:29.272359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:29.272359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:29.272359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:29.272359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:29.272359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:29.273464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:29.273464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:29.273464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:29.273464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:29.273464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:29.273464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:29.273464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:29.273464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:29.273464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:29.273464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:29.273464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:29.273464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:29.273464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:29.273464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:29.273464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:29.273464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:29.274561 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:29.274561 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:29.274561 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:29.274561 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:29.274561 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:29.274561 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:29.274561 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:29.274561 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:29.274561 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:29.274561 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:29.274561 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:12:29.274561 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:29.274561 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 186/365] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:12:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:29.275850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427af02-f40a-44b4-8ddc-d0d82427eba4 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:29.296036 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33136bcc-1355-4977-9fde-cabe9bc7d49e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:29.346972 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc3943-318c-4d99-82f5-0b4d685d05c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:29.347593 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc3943-318c-4d99-82f5-0b4d685d05c3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:29.347874 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc3943-318c-4d99-82f5-0b4d685d05c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:29.348148 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc3943-318c-4d99-82f5-0b4d685d05c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:29.348884 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc3943-318c-4d99-82f5-0b4d685d05c3 None admin] RBAC: Adding query filter params (role.id=14b4522936a24e78a58d9f0dcae537be, user.id=a2193dd47c9f4bed8d384019235af4cb, scope.system=all) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:29.349196 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc3943-318c-4d99-82f5-0b4d685d05c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:29.350652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc3943-318c-4d99-82f5-0b4d685d05c3 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:29.365009 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 180/366] 10.222.0.61 () {56 vars in 1308 bytes} [Fri Aug 19 19:12:29 2022] GET /identity/v3/role_assignments?user.id=a2193dd47c9f4bed8d384019235af4cb&scope.system=all&role.id=14b4522936a24e78a58d9f0dcae537be => generated 510 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:29.366700 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc3943-318c-4d99-82f5-0b4d685d05c3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:29.402211 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427af02-f40a-44b4-8ddc-d0d82427eba4 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:29.424019 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:29.448184 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c02dca-64bd-4070-99b9-4fd2c3aa53c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:29.449113 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c02dca-64bd-4070-99b9-4fd2c3aa53c0 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:29.449532 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c02dca-64bd-4070-99b9-4fd2c3aa53c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:29.450022 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c02dca-64bd-4070-99b9-4fd2c3aa53c0 None admin] PATH_INFO: `/v3/groups/71314a20dde7428db3dd15076e1eae84` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:29.453530 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c02dca-64bd-4070-99b9-4fd2c3aa53c0 None admin] RBAC: Authorizing `identity:get_group(group_id=71314a20dde7428db3dd15076e1eae84)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:29.455433 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c02dca-64bd-4070-99b9-4fd2c3aa53c0 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:29.457356 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 187/367] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Aug 19 19:12:29 2022] GET /identity/v3/groups/71314a20dde7428db3dd15076e1eae84 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:29.458387 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c02dca-64bd-4070-99b9-4fd2c3aa53c0 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:29.500468 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc3943-318c-4d99-82f5-0b4d685d05c3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:29.519633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:29.544992 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4293f-7a47-408f-8c66-42547c02d90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:29.545618 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4293f-7a47-408f-8c66-42547c02d90e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:29.545899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4293f-7a47-408f-8c66-42547c02d90e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:29.546170 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4293f-7a47-408f-8c66-42547c02d90e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:29.546944 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4293f-7a47-408f-8c66-42547c02d90e None admin] RBAC: Adding query filter params (group.id=71314a20dde7428db3dd15076e1eae84, role.id=097319c04e61414e80385247dbf5003a, scope.project.id=91bbd1bb0efc40338fac7e525cc596d1) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:29.547254 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4293f-7a47-408f-8c66-42547c02d90e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:29.548996 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4293f-7a47-408f-8c66-42547c02d90e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:29.557290 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 181/368] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Aug 19 19:12:29 2022] GET /identity/v3/role_assignments?group.id=71314a20dde7428db3dd15076e1eae84&scope.project.id=91bbd1bb0efc40338fac7e525cc596d1&role.id=097319c04e61414e80385247dbf5003a => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:29.558207 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4293f-7a47-408f-8c66-42547c02d90e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:29.600593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c02dca-64bd-4070-99b9-4fd2c3aa53c0 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:29.645894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec3332-a2ba-435a-bce4-901f60e3c2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:29.646820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec3332-a2ba-435a-bce4-901f60e3c2fc None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:29.647203 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec3332-a2ba-435a-bce4-901f60e3c2fc None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:29.647586 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec3332-a2ba-435a-bce4-901f60e3c2fc None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:29.648366 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec3332-a2ba-435a-bce4-901f60e3c2fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:29.648673 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec3332-a2ba-435a-bce4-901f60e3c2fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:29.650183 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec3332-a2ba-435a-bce4-901f60e3c2fc None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:29.660791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 188/369] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:12:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:29.661756 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec3332-a2ba-435a-bce4-901f60e3c2fc None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:29.688873 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4293f-7a47-408f-8c66-42547c02d90e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:29.738554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e10063-753a-423f-983e-65c7cd6391cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:29.739456 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e10063-753a-423f-983e-65c7cd6391cf None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:29.740391 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e10063-753a-423f-983e-65c7cd6391cf None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:29.740766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e10063-753a-423f-983e-65c7cd6391cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:29.741794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e10063-753a-423f-983e-65c7cd6391cf None admin] RBAC: Adding query filter params (group.id=71314a20dde7428db3dd15076e1eae84, role.id=83a904d35afc48fe9f8d55c0fd1597d8, scope.project.id=35715c28855e4d0b93c644f5a3804760) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:29.742344 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e10063-753a-423f-983e-65c7cd6391cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:29.744366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e10063-753a-423f-983e-65c7cd6391cf None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:29.751773 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 182/370] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Aug 19 19:12:29 2022] GET /identity/v3/role_assignments?group.id=71314a20dde7428db3dd15076e1eae84&scope.project.id=35715c28855e4d0b93c644f5a3804760&role.id=83a904d35afc48fe9f8d55c0fd1597d8 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:29.752775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e10063-753a-423f-983e-65c7cd6391cf None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:29.804835 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:29.818203 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:29.892763 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e10063-753a-423f-983e-65c7cd6391cf None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:29.931480 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec3332-a2ba-435a-bce4-901f60e3c2fc None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:29.933735 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac11493-fca9-4797-b8ef-3b38019510b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:29.934377 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac11493-fca9-4797-b8ef-3b38019510b3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:29.934691 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac11493-fca9-4797-b8ef-3b38019510b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:29.935242 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac11493-fca9-4797-b8ef-3b38019510b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:30.014186 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac11493-fca9-4797-b8ef-3b38019510b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:30.015354 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5871451-f9a6-4f9d-b896-c47171749685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:30.015713 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac11493-fca9-4797-b8ef-3b38019510b3 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:30.016104 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5871451-f9a6-4f9d-b896-c47171749685 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:30.016385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5871451-f9a6-4f9d-b896-c47171749685 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:30.016655 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5871451-f9a6-4f9d-b896-c47171749685 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:30.051166 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5871451-f9a6-4f9d-b896-c47171749685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:30.056383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-b5871451-f9a6-4f9d-b896-c47171749685 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:12:30.056383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:30.056383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:30.056383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:30.056383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:30.056383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:30.056383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:30.056383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:30.056383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:30.056383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:30.056383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:30.056383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:30.056383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:30.056383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:30.056383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:30.056383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:30.057270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:30.057270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:30.057270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:30.057270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:30.057270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:30.057270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:30.057270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:30.057270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:30.057270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:30.057270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:30.057270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:30.057270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:30.057270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:30.057270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:30.057270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:30.057270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:30.058133 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:30.058133 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:30.058133 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:30.058133 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:30.058133 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:30.058133 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:30.058133 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:30.058133 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:30.058133 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:30.058133 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:30.058133 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:12:30.058133 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:30.058133 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 189/371] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Aug 19 19:12:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:30.067674 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5871451-f9a6-4f9d-b896-c47171749685 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:30.076794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:30.154329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 183/372] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:30.163618 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac11493-fca9-4797-b8ef-3b38019510b3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:30.255966 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5871451-f9a6-4f9d-b896-c47171749685 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:30.266965 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:30.300963 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcc2aa-f867-4e26-99db-9ce017d8c1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:30.301955 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcc2aa-f867-4e26-99db-9ce017d8c1f3 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:30.302429 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcc2aa-f867-4e26-99db-9ce017d8c1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:30.302952 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcc2aa-f867-4e26-99db-9ce017d8c1f3 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:30.304053 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcc2aa-f867-4e26-99db-9ce017d8c1f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:30.304601 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcc2aa-f867-4e26-99db-9ce017d8c1f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:30.307071 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcc2aa-f867-4e26-99db-9ce017d8c1f3 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:30.310364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac11493-fca9-4797-b8ef-3b38019510b3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:30.322266 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 190/373] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:30.328807 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcc2aa-f867-4e26-99db-9ce017d8c1f3 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:30.350351 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7237d-6ef5-48c8-8f5d-cefabe348c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:30.351032 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7237d-6ef5-48c8-8f5d-cefabe348c21 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:30.351306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7237d-6ef5-48c8-8f5d-cefabe348c21 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:30.351677 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7237d-6ef5-48c8-8f5d-cefabe348c21 None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:30.353556 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7237d-6ef5-48c8-8f5d-cefabe348c21 None admin] RBAC: Authorizing `identity:get_project(project_id=35715c28855e4d0b93c644f5a3804760)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:30.354241 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7237d-6ef5-48c8-8f5d-cefabe348c21 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:30.356042 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 184/374] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:30 2022] GET /identity/v3/projects/35715c28855e4d0b93c644f5a3804760 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:30.361591 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7237d-6ef5-48c8-8f5d-cefabe348c21 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:30.380032 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:30.451746 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcc2aa-f867-4e26-99db-9ce017d8c1f3 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:30.474508 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7237d-6ef5-48c8-8f5d-cefabe348c21 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:30.490917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f55f20-28ed-4f3e-b6ee-2e0e29f78ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:30.491864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f55f20-28ed-4f3e-b6ee-2e0e29f78ce9 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:30.492534 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f55f20-28ed-4f3e-b6ee-2e0e29f78ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:30.493012 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f55f20-28ed-4f3e-b6ee-2e0e29f78ce9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:30.512134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453fb81-4abe-4889-946c-207f5186673b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:30.512704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453fb81-4abe-4889-946c-207f5186673b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:30.512984 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453fb81-4abe-4889-946c-207f5186673b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:30.513259 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453fb81-4abe-4889-946c-207f5186673b None admin] PATH_INFO: `/v3/groups/71314a20dde7428db3dd15076e1eae84` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:30.515147 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453fb81-4abe-4889-946c-207f5186673b None admin] RBAC: Authorizing `identity:get_group(group_id=71314a20dde7428db3dd15076e1eae84)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:30.516697 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453fb81-4abe-4889-946c-207f5186673b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:30.519209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 185/375] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Aug 19 19:12:30 2022] GET /identity/v3/groups/71314a20dde7428db3dd15076e1eae84 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:30.527348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453fb81-4abe-4889-946c-207f5186673b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:30.540211 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:30.586153 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f55f20-28ed-4f3e-b6ee-2e0e29f78ce9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:30.588645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f55f20-28ed-4f3e-b6ee-2e0e29f78ce9 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:30.627514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:30.648704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453fb81-4abe-4889-946c-207f5186673b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:30.688066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81991551-7e10-47fa-a595-ab61ebd2215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:30.689111 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81991551-7e10-47fa-a595-ab61ebd2215e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:30.690451 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81991551-7e10-47fa-a595-ab61ebd2215e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:30.690451 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81991551-7e10-47fa-a595-ab61ebd2215e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:30.691660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81991551-7e10-47fa-a595-ab61ebd2215e None admin] RBAC: Adding query filter params (group.id=71314a20dde7428db3dd15076e1eae84, role.id=097319c04e61414e80385247dbf5003a, scope.project.id=35715c28855e4d0b93c644f5a3804760) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:30.692073 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81991551-7e10-47fa-a595-ab61ebd2215e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:30.693927 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81991551-7e10-47fa-a595-ab61ebd2215e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:30.701476 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 186/376] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Aug 19 19:12:30 2022] GET /identity/v3/role_assignments?group.id=71314a20dde7428db3dd15076e1eae84&scope.project.id=35715c28855e4d0b93c644f5a3804760&role.id=097319c04e61414e80385247dbf5003a => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:30.706907 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 191/377] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 19:12:30.713917 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81991551-7e10-47fa-a595-ab61ebd2215e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:30.861929 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81991551-7e10-47fa-a595-ab61ebd2215e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:30.903399 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2450c-9464-4385-8f79-1942b5a08d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:30.904127 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2450c-9464-4385-8f79-1942b5a08d52 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:30.904408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2450c-9464-4385-8f79-1942b5a08d52 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:30.904680 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2450c-9464-4385-8f79-1942b5a08d52 None admin] PATH_INFO: `/v3/projects/1351328a9fb54f3696993b85a91b70f8` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:30.905861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2450c-9464-4385-8f79-1942b5a08d52 None admin] RBAC: Authorizing `identity:get_project(project_id=1351328a9fb54f3696993b85a91b70f8)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:30.907367 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2450c-9464-4385-8f79-1942b5a08d52 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:30.909360 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 187/378] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:30 2022] GET /identity/v3/projects/1351328a9fb54f3696993b85a91b70f8 => generated 344 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:30.916804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f55f20-28ed-4f3e-b6ee-2e0e29f78ce9 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:31.002692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:31.048090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f55f20-28ed-4f3e-b6ee-2e0e29f78ce9 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:31.089361 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c9d94-82b6-41ca-970c-5c42fbf23c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:31.090082 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c9d94-82b6-41ca-970c-5c42fbf23c79 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:31.090363 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c9d94-82b6-41ca-970c-5c42fbf23c79 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:31.090751 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c9d94-82b6-41ca-970c-5c42fbf23c79 None admin] PATH_INFO: `/v3/groups/37d00f4392004ba097a8e48f1cb90d50` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:31.097278 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c9d94-82b6-41ca-970c-5c42fbf23c79 None admin] RBAC: Authorizing `identity:get_group(group_id=37d00f4392004ba097a8e48f1cb90d50)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:31.098789 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c9d94-82b6-41ca-970c-5c42fbf23c79 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:31.100547 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 192/379] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Aug 19 19:12:30 2022] GET /identity/v3/groups/37d00f4392004ba097a8e48f1cb90d50 => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:31.106728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2450c-9464-4385-8f79-1942b5a08d52 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:31.146135 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:31.256505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2450c-9464-4385-8f79-1942b5a08d52 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:31.299782 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6572247-550b-4702-9296-04e4e0d9129e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:31.300449 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6572247-550b-4702-9296-04e4e0d9129e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:31.300673 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6572247-550b-4702-9296-04e4e0d9129e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:31.300945 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6572247-550b-4702-9296-04e4e0d9129e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:31.301670 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6572247-550b-4702-9296-04e4e0d9129e None admin] RBAC: Adding query filter params (group.id=37d00f4392004ba097a8e48f1cb90d50, role.id=8fdfbc4aaf68468f89a5ae3450b8488d, scope.project.id=1351328a9fb54f3696993b85a91b70f8) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:31.301976 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6572247-550b-4702-9296-04e4e0d9129e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:31.303497 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6572247-550b-4702-9296-04e4e0d9129e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:31.309268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 188/380] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Aug 19 19:12:31 2022] GET /identity/v3/role_assignments?group.id=37d00f4392004ba097a8e48f1cb90d50&scope.project.id=1351328a9fb54f3696993b85a91b70f8&role.id=8fdfbc4aaf68468f89a5ae3450b8488d => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:32.123906 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b50e6-6cad-402b-866a-6d779fec4db7 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:32.124417 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b50e6-6cad-402b-866a-6d779fec4db7 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:32.124417 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b50e6-6cad-402b-866a-6d779fec4db7 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:32.126108 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 193/381] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:32.131177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c56d2-81f0-4741-a689-8f976476f3c2 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:32.132033 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c56d2-81f0-4741-a689-8f976476f3c2 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:32.132527 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c56d2-81f0-4741-a689-8f976476f3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:32.164194 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-8f4c56d2-81f0-4741-a689-8f976476f3c2 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:32.169381 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8f4c56d2-81f0-4741-a689-8f976476f3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:32.262005 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 189/382] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:32.458972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a770c-4437-4f21-aa24-02359ca01cb8 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:32.459632 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a770c-4437-4f21-aa24-02359ca01cb8 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:32.460116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a770c-4437-4f21-aa24-02359ca01cb8 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:32.461650 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 194/383] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:32.467769 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0988dbb-50c6-45fe-a202-50f31066673e None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:32.468057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0988dbb-50c6-45fe-a202-50f31066673e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:32.468334 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0988dbb-50c6-45fe-a202-50f31066673e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:32.484954 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:32.490985 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-f0988dbb-50c6-45fe-a202-50f31066673e None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:32.492230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f0988dbb-50c6-45fe-a202-50f31066673e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:32.588172 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 190/384] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:32.674199 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a770c-4437-4f21-aa24-02359ca01cb8 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:32.819204 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a770c-4437-4f21-aa24-02359ca01cb8 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:32.862816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd75bd0-c142-4462-9fcc-32dd150d8072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:32.863457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd75bd0-c142-4462-9fcc-32dd150d8072 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:32.863733 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd75bd0-c142-4462-9fcc-32dd150d8072 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:32.864000 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd75bd0-c142-4462-9fcc-32dd150d8072 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:32.878545 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:32.883785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd75bd0-c142-4462-9fcc-32dd150d8072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:32.888542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-1fd75bd0-c142-4462-9fcc-32dd150d8072 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:32.888542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:32.888542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:32.888542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:32.888542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:32.888542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:32.888542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:32.888542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:32.888542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:32.888542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:32.888542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:32.888542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:32.888542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:32.888542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:32.888542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:32.888542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:32.889431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:32.889431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:32.889431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:32.889431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:32.889431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:32.889431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:32.889431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:32.889431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:32.889431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:32.889431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:32.889431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:32.889431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:32.889431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:32.889431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:32.889431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:32.889431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:32.890583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:32.890583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:32.890583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:32.890583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:32.890583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:32.890583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:32.890583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:32.890583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:32.890583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:32.890583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:32.890583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:32.890583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:32.890583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 195/385] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:32.896913 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0988dbb-50c6-45fe-a202-50f31066673e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:32.935412 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dade6-1207-4a0a-9d73-a263544463bd None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:32.935714 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dade6-1207-4a0a-9d73-a263544463bd None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:32.935979 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dade6-1207-4a0a-9d73-a263544463bd None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:32.938266 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 196/386] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:12:32.943513 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02c397-f047-43e7-b536-4b016140dea0 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:32.943968 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02c397-f047-43e7-b536-4b016140dea0 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:32.944244 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02c397-f047-43e7-b536-4b016140dea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:32.974497 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-ec02c397-f047-43e7-b536-4b016140dea0 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:32.975758 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-ec02c397-f047-43e7-b536-4b016140dea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:33.051126 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0988dbb-50c6-45fe-a202-50f31066673e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:33.068520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 197/387] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:33.069438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02c397-f047-43e7-b536-4b016140dea0 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:33.095401 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc358e4-1a45-425a-b67d-348833900b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:33.096425 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc358e4-1a45-425a-b67d-348833900b72 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:33.096932 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc358e4-1a45-425a-b67d-348833900b72 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:33.097409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc358e4-1a45-425a-b67d-348833900b72 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:33.098258 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc358e4-1a45-425a-b67d-348833900b72 None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:33.098770 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc358e4-1a45-425a-b67d-348833900b72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:33.100372 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc358e4-1a45-425a-b67d-348833900b72 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:33.106832 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:33.118893 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 191/388] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:33.125240 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc358e4-1a45-425a-b67d-348833900b72 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:33.281462 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02c397-f047-43e7-b536-4b016140dea0 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:33.325715 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:33.341333 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc358e4-1a45-425a-b67d-348833900b72 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:33.347897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61488a-5fe1-4bbc-b728-e1f2d419e850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:33.348862 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61488a-5fe1-4bbc-b728-e1f2d419e850 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:33.349340 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61488a-5fe1-4bbc-b728-e1f2d419e850 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:33.354923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61488a-5fe1-4bbc-b728-e1f2d419e850 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:33.382856 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22de648-c4de-4e5d-be9f-d2b47caec991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:33.383051 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61488a-5fe1-4bbc-b728-e1f2d419e850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:33.384014 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22de648-c4de-4e5d-be9f-d2b47caec991 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:33.384786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22de648-c4de-4e5d-be9f-d2b47caec991 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:33.385356 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22de648-c4de-4e5d-be9f-d2b47caec991 None admin] PATH_INFO: `/v3/groups/71314a20dde7428db3dd15076e1eae84` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:33.386763 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22de648-c4de-4e5d-be9f-d2b47caec991 None admin] RBAC: Authorizing `identity:get_group(group_id=71314a20dde7428db3dd15076e1eae84)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:33.388202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-dc61488a-5fe1-4bbc-b728-e1f2d419e850 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:12:33.388202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:33.388202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:33.388202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:33.388202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:33.388202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:33.388202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:33.388202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:33.388202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:33.388202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:33.388202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:33.388202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:33.388202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:33.388202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:33.388202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:33.388202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:33.389062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:33.389062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:33.389062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:33.389062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:33.389062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:33.389062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:33.389062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:33.389062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:33.389062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:33.389062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:33.389062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:33.389062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:33.389062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:33.389062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:33.389062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:33.389062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:33.389857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:33.389857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:33.389857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:33.389857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:33.389857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:33.389857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:33.389857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:33.389857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:33.389857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:33.389857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:33.389857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:12:33.389857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:33.389857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 198/389] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:12:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:33.391350 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22de648-c4de-4e5d-be9f-d2b47caec991 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:33.393494 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 192/390] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Aug 19 19:12:33 2022] GET /identity/v3/groups/71314a20dde7428db3dd15076e1eae84 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:33.395333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61488a-5fe1-4bbc-b728-e1f2d419e850 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:33.399153 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22de648-c4de-4e5d-be9f-d2b47caec991 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:33.486135 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:33.526062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61488a-5fe1-4bbc-b728-e1f2d419e850 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:33.529103 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22de648-c4de-4e5d-be9f-d2b47caec991 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:33.563579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8db71-a321-417d-896f-c254fe251838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:33.564190 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8db71-a321-417d-896f-c254fe251838 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:33.564472 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8db71-a321-417d-896f-c254fe251838 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:33.564728 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8db71-a321-417d-896f-c254fe251838 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:33.565517 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8db71-a321-417d-896f-c254fe251838 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:33.565834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8db71-a321-417d-896f-c254fe251838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:33.567614 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8db71-a321-417d-896f-c254fe251838 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:33.573408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c921ef-5465-43b0-b98c-55d978334bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:33.573408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c921ef-5465-43b0-b98c-55d978334bcd None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:33.573408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c921ef-5465-43b0-b98c-55d978334bcd None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:33.573408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c921ef-5465-43b0-b98c-55d978334bcd None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:33.574481 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c921ef-5465-43b0-b98c-55d978334bcd None admin] RBAC: Authorizing `identity:get_project(project_id=91bbd1bb0efc40338fac7e525cc596d1)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:33.576040 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c921ef-5465-43b0-b98c-55d978334bcd None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:33.582222 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 199/391] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:12:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:33.582346 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 193/392] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:33 2022] GET /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:33.583175 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8db71-a321-417d-896f-c254fe251838 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:33.583526 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9614652-2de0-4957-94b9-588b701cb3fe None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:33.583808 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9614652-2de0-4957-94b9-588b701cb3fe None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:33.584077 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9614652-2de0-4957-94b9-588b701cb3fe None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:33.585440 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 194/393] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:33.588969 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9614652-2de0-4957-94b9-588b701cb3fe None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:33.633817 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:33.695168 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8db71-a321-417d-896f-c254fe251838 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:33.702374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9614652-2de0-4957-94b9-588b701cb3fe None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:33.732781 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c98e7-4cbb-48d6-a02e-51781be11d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:33.733400 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c98e7-4cbb-48d6-a02e-51781be11d4b None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:33.733675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c98e7-4cbb-48d6-a02e-51781be11d4b None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:33.733939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c98e7-4cbb-48d6-a02e-51781be11d4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:33.737216 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fe416-4c83-4a77-a91c-1cb6856c9245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:33.737849 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fe416-4c83-4a77-a91c-1cb6856c9245 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:33.738129 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fe416-4c83-4a77-a91c-1cb6856c9245 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:33.738403 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fe416-4c83-4a77-a91c-1cb6856c9245 None admin] PATH_INFO: `/v3/groups/71314a20dde7428db3dd15076e1eae84` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:33.739560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fe416-4c83-4a77-a91c-1cb6856c9245 None admin] RBAC: Authorizing `identity:get_group(group_id=71314a20dde7428db3dd15076e1eae84)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:33.740997 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fe416-4c83-4a77-a91c-1cb6856c9245 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:33.742668 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 195/394] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Aug 19 19:12:33 2022] GET /identity/v3/groups/71314a20dde7428db3dd15076e1eae84 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:33.743474 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fe416-4c83-4a77-a91c-1cb6856c9245 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:33.745288 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c98e7-4cbb-48d6-a02e-51781be11d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:33.749833 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:33.751295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-f62c98e7-4cbb-48d6-a02e-51781be11d4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:33.751295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:33.751295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:33.751295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:33.751295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:33.751295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:33.751295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:33.751295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:33.751295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:33.751295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:33.751295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:33.751295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:33.751295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:33.751295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:33.751295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:33.751295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:33.752232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:33.752232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:33.752232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:33.752232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:33.752232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:33.752232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:33.752232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:33.752232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:33.752232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:33.752232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:33.752232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:33.752232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:33.752232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:33.752232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:33.752232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:33.752232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:33.753034 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:33.753034 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:33.753034 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:33.753034 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:33.753034 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:33.753034 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:33.753034 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:33.753034 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:33.753034 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:33.753034 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:33.753034 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:33.753034 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:33.753034 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 200/395] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:33.753691 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ae684-b10d-4a20-acf7-ab5789cb6283 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:33.754140 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ae684-b10d-4a20-acf7-ab5789cb6283 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:33.754140 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ae684-b10d-4a20-acf7-ab5789cb6283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:33.773264 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-5a2ae684-b10d-4a20-acf7-ab5789cb6283 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:33.774449 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-5a2ae684-b10d-4a20-acf7-ab5789cb6283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:33.850767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 201/396] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:33.851573 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ae684-b10d-4a20-acf7-ab5789cb6283 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:33.860936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fe416-4c83-4a77-a91c-1cb6856c9245 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:33.888454 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:33.900315 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea43af5-c53a-4efc-83a2-34a07957e7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:33.901365 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea43af5-c53a-4efc-83a2-34a07957e7eb None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:33.902185 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea43af5-c53a-4efc-83a2-34a07957e7eb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:33.902653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea43af5-c53a-4efc-83a2-34a07957e7eb None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1/groups/71314a20dde7428db3dd15076e1eae84/roles/83a904d35afc48fe9f8d55c0fd1597d8` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:33.905631 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea43af5-c53a-4efc-83a2-34a07957e7eb None admin] RBAC: Authorizing `identity:create_grant(project_id=91bbd1bb0efc40338fac7e525cc596d1, group_id=71314a20dde7428db3dd15076e1eae84, role_id=83a904d35afc48fe9f8d55c0fd1597d8)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:33.907285 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea43af5-c53a-4efc-83a2-34a07957e7eb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:33.957488 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ae684-b10d-4a20-acf7-ab5789cb6283 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:33.996026 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 196/397] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Aug 19 19:12:33 2022] PUT /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1/groups/71314a20dde7428db3dd15076e1eae84/roles/83a904d35afc48fe9f8d55c0fd1597d8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:12:33.997167 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea43af5-c53a-4efc-83a2-34a07957e7eb None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:34.000724 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89061892-db3a-4342-ad3d-1950ff45a142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:34.001377 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89061892-db3a-4342-ad3d-1950ff45a142 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:34.001894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89061892-db3a-4342-ad3d-1950ff45a142 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:34.002000 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89061892-db3a-4342-ad3d-1950ff45a142 None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:34.004211 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89061892-db3a-4342-ad3d-1950ff45a142 None admin] RBAC: Authorizing `identity:get_project(project_id=91bbd1bb0efc40338fac7e525cc596d1)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:34.004787 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89061892-db3a-4342-ad3d-1950ff45a142 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:34.006972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 202/398] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:33 2022] GET /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:34.013548 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89061892-db3a-4342-ad3d-1950ff45a142 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:34.095020 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:34.138379 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89061892-db3a-4342-ad3d-1950ff45a142 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:34.142912 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:34.152886 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea43af5-c53a-4efc-83a2-34a07957e7eb None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:34.192213 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc46e1c-1ef6-4cef-8d05-80cbe0847b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:34.193357 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc46e1c-1ef6-4cef-8d05-80cbe0847b17 None admin] REQUEST_METHOD: `PUT` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:34.193870 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc46e1c-1ef6-4cef-8d05-80cbe0847b17 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:34.194285 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa953fc1-341b-4755-adb7-b1becf7b76ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:34.194552 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc46e1c-1ef6-4cef-8d05-80cbe0847b17 None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1/groups/71314a20dde7428db3dd15076e1eae84/roles/097319c04e61414e80385247dbf5003a` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:34.195053 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa953fc1-341b-4755-adb7-b1becf7b76ed None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:34.195406 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa953fc1-341b-4755-adb7-b1becf7b76ed None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:34.195725 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa953fc1-341b-4755-adb7-b1becf7b76ed None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:34.197419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa953fc1-341b-4755-adb7-b1becf7b76ed None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:34.197844 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa953fc1-341b-4755-adb7-b1becf7b76ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:34.198605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc46e1c-1ef6-4cef-8d05-80cbe0847b17 None admin] RBAC: Authorizing `identity:create_grant(project_id=91bbd1bb0efc40338fac7e525cc596d1, group_id=71314a20dde7428db3dd15076e1eae84, role_id=097319c04e61414e80385247dbf5003a)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:34.199431 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa953fc1-341b-4755-adb7-b1becf7b76ed None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:34.200412 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc46e1c-1ef6-4cef-8d05-80cbe0847b17 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:34.214846 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 197/399] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:34.221198 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa953fc1-341b-4755-adb7-b1becf7b76ed None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:34.291317 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 203/400] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Aug 19 19:12:34 2022] PUT /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1/groups/71314a20dde7428db3dd15076e1eae84/roles/097319c04e61414e80385247dbf5003a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 19:12:34.312532 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc46e1c-1ef6-4cef-8d05-80cbe0847b17 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:34.361355 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa953fc1-341b-4755-adb7-b1becf7b76ed None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:34.399763 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:34.416036 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381909c-0c01-46e1-be58-ed37f417b253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:34.416709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381909c-0c01-46e1-be58-ed37f417b253 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:34.416981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381909c-0c01-46e1-be58-ed37f417b253 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:34.417248 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381909c-0c01-46e1-be58-ed37f417b253 None admin] PATH_INFO: `/v3/groups/71314a20dde7428db3dd15076e1eae84` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:34.418998 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381909c-0c01-46e1-be58-ed37f417b253 None admin] RBAC: Authorizing `identity:get_group(group_id=71314a20dde7428db3dd15076e1eae84)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:34.420785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381909c-0c01-46e1-be58-ed37f417b253 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:34.423200 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 198/401] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Aug 19 19:12:34 2022] GET /identity/v3/groups/71314a20dde7428db3dd15076e1eae84 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:34.425046 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d7f96-9d03-44bc-b9ff-a0f91489aab9 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:34.425323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d7f96-9d03-44bc-b9ff-a0f91489aab9 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:34.425589 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d7f96-9d03-44bc-b9ff-a0f91489aab9 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:34.427433 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 199/402] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:34.428431 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d7f96-9d03-44bc-b9ff-a0f91489aab9 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:34.449048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc46e1c-1ef6-4cef-8d05-80cbe0847b17 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:34.494602 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a7798-d0a0-4f9f-9f01-ad7007b084bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:34.495625 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a7798-d0a0-4f9f-9f01-ad7007b084bd None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:34.495948 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a7798-d0a0-4f9f-9f01-ad7007b084bd None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:34.496272 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a7798-d0a0-4f9f-9f01-ad7007b084bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:34.511041 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a7798-d0a0-4f9f-9f01-ad7007b084bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:34.516064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-e68a7798-d0a0-4f9f-9f01-ad7007b084bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:12:34.516064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:34.516064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:34.516064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:34.516064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:34.516064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:34.516064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:34.516064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:34.516064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:34.516064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:34.516064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:34.516064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:34.516064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:34.516064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:34.516064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:34.516064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:34.517141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:34.517141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:34.517141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:34.517141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:34.517141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:34.517141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:34.517141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:34.517141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:34.517141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:34.517141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:34.517141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:34.517141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:34.517141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:34.517141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:34.517141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:34.517141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:34.518094 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:34.518094 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:34.518094 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:34.518094 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:34.518094 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:34.518094 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:34.518094 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:34.518094 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:34.518094 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:34.518094 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:34.518094 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:12:34.518094 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:34.518094 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 204/403] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:12:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:34.523070 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e57502-e7b8-48ee-8697-d86d7779ed2f None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:34.523070 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e57502-e7b8-48ee-8697-d86d7779ed2f None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:34.523070 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e57502-e7b8-48ee-8697-d86d7779ed2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:34.541616 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-c5e57502-e7b8-48ee-8697-d86d7779ed2f None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:34.543721 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-c5e57502-e7b8-48ee-8697-d86d7779ed2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:34.575809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:34.580351 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d7f96-9d03-44bc-b9ff-a0f91489aab9 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:34.633501 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce680f4-7dd0-4760-b811-f18c3a7faa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:34.634515 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce680f4-7dd0-4760-b811-f18c3a7faa65 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:34.634995 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce680f4-7dd0-4760-b811-f18c3a7faa65 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:34.635413 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce680f4-7dd0-4760-b811-f18c3a7faa65 None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:34.637266 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce680f4-7dd0-4760-b811-f18c3a7faa65 None admin] RBAC: Authorizing `identity:get_project(project_id=35715c28855e4d0b93c644f5a3804760)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:34.639891 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce680f4-7dd0-4760-b811-f18c3a7faa65 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:34.642154 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 200/404] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:34 2022] GET /identity/v3/projects/35715c28855e4d0b93c644f5a3804760 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:34.647073 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce680f4-7dd0-4760-b811-f18c3a7faa65 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:34.655281 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 205/405] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:34.656259 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e57502-e7b8-48ee-8697-d86d7779ed2f None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:34.716463 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:34.764068 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce680f4-7dd0-4760-b811-f18c3a7faa65 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:34.780950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e57502-e7b8-48ee-8697-d86d7779ed2f None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:34.802105 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011e02a-679d-409f-9f5b-dc4cdf60f150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:34.803127 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011e02a-679d-409f-9f5b-dc4cdf60f150 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:34.803600 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011e02a-679d-409f-9f5b-dc4cdf60f150 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:34.804078 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011e02a-679d-409f-9f5b-dc4cdf60f150 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:34.804935 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011e02a-679d-409f-9f5b-dc4cdf60f150 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:34.805498 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011e02a-679d-409f-9f5b-dc4cdf60f150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:34.807805 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011e02a-679d-409f-9f5b-dc4cdf60f150 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:34.818273 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 201/406] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:12:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:34.823207 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712279f-e3ec-406c-bfc6-f92fde3d0b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:34.827229 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011e02a-679d-409f-9f5b-dc4cdf60f150 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:34.827336 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712279f-e3ec-406c-bfc6-f92fde3d0b63 None admin] REQUEST_METHOD: `PUT` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:34.827336 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712279f-e3ec-406c-bfc6-f92fde3d0b63 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:34.827336 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712279f-e3ec-406c-bfc6-f92fde3d0b63 None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760/groups/71314a20dde7428db3dd15076e1eae84/roles/83a904d35afc48fe9f8d55c0fd1597d8` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:34.827336 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712279f-e3ec-406c-bfc6-f92fde3d0b63 None admin] RBAC: Authorizing `identity:create_grant(project_id=35715c28855e4d0b93c644f5a3804760, group_id=71314a20dde7428db3dd15076e1eae84, role_id=83a904d35afc48fe9f8d55c0fd1597d8)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:34.827818 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712279f-e3ec-406c-bfc6-f92fde3d0b63 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:34.935746 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011e02a-679d-409f-9f5b-dc4cdf60f150 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:34.949338 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 206/407] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Aug 19 19:12:34 2022] PUT /identity/v3/projects/35715c28855e4d0b93c644f5a3804760/groups/71314a20dde7428db3dd15076e1eae84/roles/83a904d35afc48fe9f8d55c0fd1597d8 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:12:34.970901 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:34.981964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b01db5-44f5-4836-8d51-36adcb137307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:34.982688 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b01db5-44f5-4836-8d51-36adcb137307 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:34.982964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b01db5-44f5-4836-8d51-36adcb137307 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:34.983280 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b01db5-44f5-4836-8d51-36adcb137307 None admin] PATH_INFO: `/v3/groups/71314a20dde7428db3dd15076e1eae84` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:34.984436 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b01db5-44f5-4836-8d51-36adcb137307 None admin] RBAC: Authorizing `identity:get_group(group_id=71314a20dde7428db3dd15076e1eae84)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:34.986069 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b01db5-44f5-4836-8d51-36adcb137307 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:34.988237 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 202/408] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Aug 19 19:12:34 2022] GET /identity/v3/groups/71314a20dde7428db3dd15076e1eae84 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:34.993880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712279f-e3ec-406c-bfc6-f92fde3d0b63 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:35.024396 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:35.120053 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b01db5-44f5-4836-8d51-36adcb137307 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:35.155233 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712279f-e3ec-406c-bfc6-f92fde3d0b63 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:35.198787 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891cd14-1fc5-43b7-96ed-c36406cb111f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:35.200007 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891cd14-1fc5-43b7-96ed-c36406cb111f None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:35.200486 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891cd14-1fc5-43b7-96ed-c36406cb111f None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:35.200954 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891cd14-1fc5-43b7-96ed-c36406cb111f None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:35.202368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891cd14-1fc5-43b7-96ed-c36406cb111f None admin] RBAC: Authorizing `identity:get_project(project_id=35715c28855e4d0b93c644f5a3804760)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:35.204965 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891cd14-1fc5-43b7-96ed-c36406cb111f None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:35.207949 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 207/409] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:34 2022] GET /identity/v3/projects/35715c28855e4d0b93c644f5a3804760 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:35.214855 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891cd14-1fc5-43b7-96ed-c36406cb111f None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:35.272869 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b01db5-44f5-4836-8d51-36adcb137307 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:35.315520 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e69b8-5ee3-4e78-bc46-e322a5d50e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:35.316154 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e69b8-5ee3-4e78-bc46-e322a5d50e57 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:35.316432 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e69b8-5ee3-4e78-bc46-e322a5d50e57 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:35.318122 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e69b8-5ee3-4e78-bc46-e322a5d50e57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:35.335865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e69b8-5ee3-4e78-bc46-e322a5d50e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:35.340681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-098e69b8-5ee3-4e78-bc46-e322a5d50e57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:12:35.340681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:35.340681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:35.340681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:35.340681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:35.340681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:35.340681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:35.340681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:35.340681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:35.340681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:35.340681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:35.340681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:35.340681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:35.340681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:35.340681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:35.340681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:35.341596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:35.341596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:35.341596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:35.341596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:35.341596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:35.341596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:35.341596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:35.341596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:35.341596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:35.341596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:35.341596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:35.341596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:35.341596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:35.341596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:35.341596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:35.341596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:35.342382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:35.342382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:35.342382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:35.342382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:35.342382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:35.342382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:35.342382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:35.342382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:35.342382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:35.342382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:35.342382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:12:35.342382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:35.342382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 203/410] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Aug 19 19:12:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:35.352497 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e69b8-5ee3-4e78-bc46-e322a5d50e57 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:35.366886 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:35.388364 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891cd14-1fc5-43b7-96ed-c36406cb111f None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:35.450886 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d735f2-84df-4407-a5fd-85fc6a4b1de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:35.451095 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:35.451500 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d735f2-84df-4407-a5fd-85fc6a4b1de4 None admin] REQUEST_METHOD: `PUT` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:35.451737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d735f2-84df-4407-a5fd-85fc6a4b1de4 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:35.452012 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d735f2-84df-4407-a5fd-85fc6a4b1de4 None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760/groups/71314a20dde7428db3dd15076e1eae84/roles/097319c04e61414e80385247dbf5003a` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:35.457777 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d735f2-84df-4407-a5fd-85fc6a4b1de4 None admin] RBAC: Authorizing `identity:create_grant(project_id=35715c28855e4d0b93c644f5a3804760, group_id=71314a20dde7428db3dd15076e1eae84, role_id=097319c04e61414e80385247dbf5003a)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:35.459297 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d735f2-84df-4407-a5fd-85fc6a4b1de4 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:35.511882 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e69b8-5ee3-4e78-bc46-e322a5d50e57 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:35.548342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293d886-3ef2-46d3-8dcc-f47c41453908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:35.548955 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293d886-3ef2-46d3-8dcc-f47c41453908 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:35.549280 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293d886-3ef2-46d3-8dcc-f47c41453908 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:35.549613 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293d886-3ef2-46d3-8dcc-f47c41453908 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:35.550675 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293d886-3ef2-46d3-8dcc-f47c41453908 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:35.550985 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293d886-3ef2-46d3-8dcc-f47c41453908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:35.552378 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293d886-3ef2-46d3-8dcc-f47c41453908 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:35.564803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 208/411] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Aug 19 19:12:35 2022] PUT /identity/v3/projects/35715c28855e4d0b93c644f5a3804760/groups/71314a20dde7428db3dd15076e1eae84/roles/097319c04e61414e80385247dbf5003a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:12:35.568741 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 204/412] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:35.583962 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d735f2-84df-4407-a5fd-85fc6a4b1de4 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:35.737124 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d735f2-84df-4407-a5fd-85fc6a4b1de4 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:35.773724 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb172e1-0755-4ec9-a0c4-5218f3be3438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:35.774346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb172e1-0755-4ec9-a0c4-5218f3be3438 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:35.775315 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb172e1-0755-4ec9-a0c4-5218f3be3438 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:35.775592 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb172e1-0755-4ec9-a0c4-5218f3be3438 None admin] PATH_INFO: `/v3/groups/37d00f4392004ba097a8e48f1cb90d50` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:35.776718 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb172e1-0755-4ec9-a0c4-5218f3be3438 None admin] RBAC: Authorizing `identity:get_group(group_id=37d00f4392004ba097a8e48f1cb90d50)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:35.778149 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb172e1-0755-4ec9-a0c4-5218f3be3438 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:35.779915 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 209/413] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Aug 19 19:12:35 2022] GET /identity/v3/groups/37d00f4392004ba097a8e48f1cb90d50 => generated 229 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:35.785533 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293d886-3ef2-46d3-8dcc-f47c41453908 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:35.910439 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293d886-3ef2-46d3-8dcc-f47c41453908 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:35.928231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:35.959501 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a42ff-071a-4dd4-939e-b44835faec4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:35.960142 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a42ff-071a-4dd4-939e-b44835faec4d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:35.960416 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a42ff-071a-4dd4-939e-b44835faec4d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:35.960685 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a42ff-071a-4dd4-939e-b44835faec4d None admin] PATH_INFO: `/v3/projects/1351328a9fb54f3696993b85a91b70f8` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:35.961804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a42ff-071a-4dd4-939e-b44835faec4d None admin] RBAC: Authorizing `identity:get_project(project_id=1351328a9fb54f3696993b85a91b70f8)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:35.964072 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a42ff-071a-4dd4-939e-b44835faec4d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:35.966076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 205/414] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:35 2022] GET /identity/v3/projects/1351328a9fb54f3696993b85a91b70f8 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:35.972032 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb172e1-0755-4ec9-a0c4-5218f3be3438 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:35.987011 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:36.101760 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb172e1-0755-4ec9-a0c4-5218f3be3438 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:36.138158 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc0f86-30d8-417b-a36c-48181a7bb28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:36.138843 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc0f86-30d8-417b-a36c-48181a7bb28b None admin] REQUEST_METHOD: `PUT` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:36.139119 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc0f86-30d8-417b-a36c-48181a7bb28b None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:36.139389 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc0f86-30d8-417b-a36c-48181a7bb28b None admin] PATH_INFO: `/v3/projects/1351328a9fb54f3696993b85a91b70f8/groups/37d00f4392004ba097a8e48f1cb90d50/roles/8fdfbc4aaf68468f89a5ae3450b8488d` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:36.141385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc0f86-30d8-417b-a36c-48181a7bb28b None admin] RBAC: Authorizing `identity:create_grant(project_id=1351328a9fb54f3696993b85a91b70f8, group_id=37d00f4392004ba097a8e48f1cb90d50, role_id=8fdfbc4aaf68468f89a5ae3450b8488d)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:36.142912 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc0f86-30d8-417b-a36c-48181a7bb28b None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:36.235200 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 210/415] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Aug 19 19:12:35 2022] PUT /identity/v3/projects/1351328a9fb54f3696993b85a91b70f8/groups/37d00f4392004ba097a8e48f1cb90d50/roles/8fdfbc4aaf68468f89a5ae3450b8488d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:12:36.794819 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b138464-f3b0-42f4-9f8a-1d954a430560 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:36.795330 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b138464-f3b0-42f4-9f8a-1d954a430560 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:36.795403 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b138464-f3b0-42f4-9f8a-1d954a430560 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:36.797079 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 206/416] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:36.802213 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1711a-f690-4c4b-8d83-4d39f0dbac60 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:36.802938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1711a-f690-4c4b-8d83-4d39f0dbac60 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:36.802938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1711a-f690-4c4b-8d83-4d39f0dbac60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:36.813463 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc9d26-f48e-4a46-ae5f-7cead5ac2e48 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:36.814052 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc9d26-f48e-4a46-ae5f-7cead5ac2e48 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:36.814573 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc9d26-f48e-4a46-ae5f-7cead5ac2e48 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:36.816365 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 207/417] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:36.822945 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccbc2c-16ee-4f99-96ba-84124ccfa456 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:36.823459 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccbc2c-16ee-4f99-96ba-84124ccfa456 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:36.823925 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccbc2c-16ee-4f99-96ba-84124ccfa456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:36.825324 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-c8f1711a-f690-4c4b-8d83-4d39f0dbac60 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:36.826465 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-c8f1711a-f690-4c4b-8d83-4d39f0dbac60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:36.845052 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-bcccbc2c-16ee-4f99-96ba-84124ccfa456 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:36.846580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-bcccbc2c-16ee-4f99-96ba-84124ccfa456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:36.958706 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 208/418] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:12:36.963590 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:36.972801 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 211/419] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:37.390595 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccbc2c-16ee-4f99-96ba-84124ccfa456 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:37.452107 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1711a-f690-4c4b-8d83-4d39f0dbac60 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:37.506656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccbc2c-16ee-4f99-96ba-84124ccfa456 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:37.518326 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:37.543595 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e31bc-a1f9-4160-bdb9-ad8f5def6129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:37.544600 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e31bc-a1f9-4160-bdb9-ad8f5def6129 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:37.545191 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e31bc-a1f9-4160-bdb9-ad8f5def6129 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:37.545653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e31bc-a1f9-4160-bdb9-ad8f5def6129 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:37.557592 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e31bc-a1f9-4160-bdb9-ad8f5def6129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:37.563057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-8b1e31bc-a1f9-4160-bdb9-ad8f5def6129 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:37.563057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:37.563057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:37.563057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:37.563057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:37.563057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:37.563057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:37.563057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:37.563057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:37.563057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:37.563057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:37.563057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:37.563057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:37.563057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:37.563057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:37.563057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:37.563968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:37.563968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:37.563968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:37.563968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:37.563968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:37.563968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:37.563968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:37.563968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:37.563968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:37.563968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:37.563968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:37.563968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:37.563968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:37.563968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:37.563968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:37.563968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:37.564766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:37.564766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:37.564766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:37.564766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:37.564766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:37.564766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:37.564766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:37.564766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:37.564766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:37.564766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:37.564766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:37.564766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:37.567408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 209/420] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:37.577805 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e31bc-a1f9-4160-bdb9-ad8f5def6129 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:37.648446 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1711a-f690-4c4b-8d83-4d39f0dbac60 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:37.716353 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ff2d8-a9fe-41a3-9ce6-d9b758f64e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:37.717537 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ff2d8-a9fe-41a3-9ce6-d9b758f64e15 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:37.722456 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ff2d8-a9fe-41a3-9ce6-d9b758f64e15 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:37.722966 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ff2d8-a9fe-41a3-9ce6-d9b758f64e15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:37.741092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ff2d8-a9fe-41a3-9ce6-d9b758f64e15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:37.748983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-8f3ff2d8-a9fe-41a3-9ce6-d9b758f64e15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:12:37.748983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:37.748983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:37.748983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:37.748983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:37.748983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:37.748983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:37.748983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:37.748983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:37.748983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:37.748983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:37.748983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:37.748983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:37.748983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:37.748983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:37.748983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:37.749893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:37.749893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:37.749893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:37.749893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:37.749893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:37.749893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:37.749893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:37.749893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:37.749893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:37.749893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:37.749893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:37.749893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:37.749893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:37.749893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:37.749893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:37.749893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:37.750737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:37.750737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:37.750737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:37.750737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:37.750737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:37.750737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:37.750737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:37.750737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:37.750737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:37.750737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:37.750737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:12:37.750737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:37.751870 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 212/421] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:12:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:37.753307 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987991c5-e0e9-4c2d-8098-a21562887ac2 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:37.753583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987991c5-e0e9-4c2d-8098-a21562887ac2 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:37.753851 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987991c5-e0e9-4c2d-8098-a21562887ac2 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:37.758576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 213/422] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:37.760336 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987991c5-e0e9-4c2d-8098-a21562887ac2 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:37.773548 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e31bc-a1f9-4160-bdb9-ad8f5def6129 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:37.816862 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643b3e9-53fc-4249-a92c-fa95a2a1a069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:37.818210 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643b3e9-53fc-4249-a92c-fa95a2a1a069 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:37.819022 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643b3e9-53fc-4249-a92c-fa95a2a1a069 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:37.819470 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643b3e9-53fc-4249-a92c-fa95a2a1a069 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:37.820608 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643b3e9-53fc-4249-a92c-fa95a2a1a069 None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:37.821286 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643b3e9-53fc-4249-a92c-fa95a2a1a069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:37.823253 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643b3e9-53fc-4249-a92c-fa95a2a1a069 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:37.834253 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 210/423] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:37.840600 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fd956-e378-4b11-a9e3-a41c0dc7dd7f None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:37.840881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fd956-e378-4b11-a9e3-a41c0dc7dd7f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:37.841152 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fd956-e378-4b11-a9e3-a41c0dc7dd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:37.846515 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:37.861631 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-264fd956-e378-4b11-a9e3-a41c0dc7dd7f None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:37.862844 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-264fd956-e378-4b11-a9e3-a41c0dc7dd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:37.890213 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987991c5-e0e9-4c2d-8098-a21562887ac2 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:37.891463 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:37.929757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83e78e-b287-45e8-883e-8b752bdfb977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:37.930914 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83e78e-b287-45e8-883e-8b752bdfb977 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:37.931388 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83e78e-b287-45e8-883e-8b752bdfb977 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:37.931847 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83e78e-b287-45e8-883e-8b752bdfb977 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:37.932699 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83e78e-b287-45e8-883e-8b752bdfb977 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:37.933207 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83e78e-b287-45e8-883e-8b752bdfb977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:37.934797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83e78e-b287-45e8-883e-8b752bdfb977 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:37.940445 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 211/424] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:37.949388 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fd956-e378-4b11-a9e3-a41c0dc7dd7f None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:37.949741 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 214/425] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:12:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:37.950884 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83e78e-b287-45e8-883e-8b752bdfb977 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:38.125658 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83e78e-b287-45e8-883e-8b752bdfb977 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:38.146682 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fd956-e378-4b11-a9e3-a41c0dc7dd7f None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:38.170857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:38.203856 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caa59a-0d46-45af-9ca7-2bfb3a3e2389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:38.203856 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caa59a-0d46-45af-9ca7-2bfb3a3e2389 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:38.203856 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caa59a-0d46-45af-9ca7-2bfb3a3e2389 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:38.203856 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caa59a-0d46-45af-9ca7-2bfb3a3e2389 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:38.224341 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a04e1-0c33-420b-937d-3ad2708defd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:38.224974 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a04e1-0c33-420b-937d-3ad2708defd7 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:38.225254 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a04e1-0c33-420b-937d-3ad2708defd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:38.225521 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a04e1-0c33-420b-937d-3ad2708defd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:38.271711 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67caa59a-0d46-45af-9ca7-2bfb3a3e2389 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:38.273176 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67caa59a-0d46-45af-9ca7-2bfb3a3e2389 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:38.292480 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:38.376756 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a04e1-0c33-420b-937d-3ad2708defd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:38.378626 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a04e1-0c33-420b-937d-3ad2708defd7 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:38.383361 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 215/426] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:38.384884 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caa59a-0d46-45af-9ca7-2bfb3a3e2389 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:38.414874 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:38.493865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 212/427] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:38.494703 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a04e1-0c33-420b-937d-3ad2708defd7 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:38.501901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caa59a-0d46-45af-9ca7-2bfb3a3e2389 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:38.539574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdf0ea-ce90-4de2-8730-ea7e2177cc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:38.540514 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdf0ea-ce90-4de2-8730-ea7e2177cc09 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:38.540926 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdf0ea-ce90-4de2-8730-ea7e2177cc09 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:38.541196 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdf0ea-ce90-4de2-8730-ea7e2177cc09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:38.552896 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdf0ea-ce90-4de2-8730-ea7e2177cc09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:38.561276 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:38.564437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-2bfdf0ea-ce90-4de2-8730-ea7e2177cc09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:38.564437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:38.564437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:38.564437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:38.564437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:38.564437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:38.564437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:38.564437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:38.564437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:38.564437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:38.564437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:38.564437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:38.564437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:38.564437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:38.564437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:38.564437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:38.565328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:38.565328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:38.565328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:38.565328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:38.565328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:38.565328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:38.565328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:38.565328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:38.565328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:38.565328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:38.565328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:38.565328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:38.565328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:38.565328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:38.565328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:38.565328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:38.566116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:38.566116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:38.566116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:38.566116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:38.566116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:38.566116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:38.566116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:38.566116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:38.566116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:38.566116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:38.566116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 19:12:38.566116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:38.566116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 216/428] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:38.567682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32304e39-fde1-4ae5-a937-0e42f89ddfa1 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:38.567682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32304e39-fde1-4ae5-a937-0e42f89ddfa1 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:38.567682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32304e39-fde1-4ae5-a937-0e42f89ddfa1 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:38.569073 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 217/429] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:38.569714 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32304e39-fde1-4ae5-a937-0e42f89ddfa1 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:38.608537 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a04e1-0c33-420b-937d-3ad2708defd7 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:38.644441 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21efc51-052d-4b55-a5e6-ba01d2e35ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:38.645140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21efc51-052d-4b55-a5e6-ba01d2e35ca4 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:38.645412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21efc51-052d-4b55-a5e6-ba01d2e35ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:38.646161 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21efc51-052d-4b55-a5e6-ba01d2e35ca4 None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:38.647014 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21efc51-052d-4b55-a5e6-ba01d2e35ca4 None admin] RBAC: Authorizing `identity:get_project(project_id=91bbd1bb0efc40338fac7e525cc596d1)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:38.648483 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21efc51-052d-4b55-a5e6-ba01d2e35ca4 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:38.651073 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 213/430] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:38 2022] GET /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:38.651759 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21efc51-052d-4b55-a5e6-ba01d2e35ca4 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:38.674350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:38.694178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32304e39-fde1-4ae5-a937-0e42f89ddfa1 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:38.731734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979f14a-f76b-46ac-8025-3f0617b6d99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:38.732362 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979f14a-f76b-46ac-8025-3f0617b6d99a None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:38.732639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979f14a-f76b-46ac-8025-3f0617b6d99a None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:38.732909 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979f14a-f76b-46ac-8025-3f0617b6d99a None admin] PATH_INFO: `/v3/projects/91bbd1bb0efc40338fac7e525cc596d1` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:38.734033 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979f14a-f76b-46ac-8025-3f0617b6d99a None admin] RBAC: Authorizing `identity:get_project(project_id=91bbd1bb0efc40338fac7e525cc596d1)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:38.735494 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979f14a-f76b-46ac-8025-3f0617b6d99a None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:38.737258 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 218/431] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:38 2022] GET /identity/v3/projects/91bbd1bb0efc40338fac7e525cc596d1 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:38.738342 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea812b-45c2-4dc5-ac91-ae45c8d9eabb None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:38.738649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea812b-45c2-4dc5-ac91-ae45c8d9eabb None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:38.738917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea812b-45c2-4dc5-ac91-ae45c8d9eabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:38.770244 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-08ea812b-45c2-4dc5-ac91-ae45c8d9eabb None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:38.770244 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-08ea812b-45c2-4dc5-ac91-ae45c8d9eabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:38.770500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21efc51-052d-4b55-a5e6-ba01d2e35ca4 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:38.799898 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:38.805835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b40fb8-6707-47a6-a67c-0bf537204195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:38.806613 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b40fb8-6707-47a6-a67c-0bf537204195 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:38.806967 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b40fb8-6707-47a6-a67c-0bf537204195 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:38.807313 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b40fb8-6707-47a6-a67c-0bf537204195 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:38.807971 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b40fb8-6707-47a6-a67c-0bf537204195 None admin] RBAC: Adding query filter params (name=member) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:38.808270 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b40fb8-6707-47a6-a67c-0bf537204195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:38.809630 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b40fb8-6707-47a6-a67c-0bf537204195 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:38.820072 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 214/432] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:12:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:38.820912 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b40fb8-6707-47a6-a67c-0bf537204195 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:38.842550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 219/433] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:38.843404 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea812b-45c2-4dc5-ac91-ae45c8d9eabb None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:38.933967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:38.944610 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b40fb8-6707-47a6-a67c-0bf537204195 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:38.954334 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea812b-45c2-4dc5-ac91-ae45c8d9eabb None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:38.982085 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8890755-eb63-4926-91b0-5939b97752fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:38.983953 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8890755-eb63-4926-91b0-5939b97752fa None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:38.984496 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8890755-eb63-4926-91b0-5939b97752fa None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:38.984992 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8890755-eb63-4926-91b0-5939b97752fa None admin] PATH_INFO: `/v3/groups/71314a20dde7428db3dd15076e1eae84` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:38.986325 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8890755-eb63-4926-91b0-5939b97752fa None admin] RBAC: Authorizing `identity:get_group(group_id=71314a20dde7428db3dd15076e1eae84)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:38.988210 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8890755-eb63-4926-91b0-5939b97752fa None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:38.990739 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 215/434] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Aug 19 19:12:38 2022] GET /identity/v3/groups/71314a20dde7428db3dd15076e1eae84 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:38.991843 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8890755-eb63-4926-91b0-5939b97752fa None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:38.998707 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d8a28-e4f0-4a98-bb0e-1d3e8ceb1bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:38.999347 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d8a28-e4f0-4a98-bb0e-1d3e8ceb1bf2 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:38.999656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d8a28-e4f0-4a98-bb0e-1d3e8ceb1bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:38.999978 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d8a28-e4f0-4a98-bb0e-1d3e8ceb1bf2 None admin] PATH_INFO: `/v3/groups/71314a20dde7428db3dd15076e1eae84` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:39.001115 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d8a28-e4f0-4a98-bb0e-1d3e8ceb1bf2 None admin] RBAC: Authorizing `identity:get_group(group_id=71314a20dde7428db3dd15076e1eae84)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:39.002583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d8a28-e4f0-4a98-bb0e-1d3e8ceb1bf2 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:39.009016 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 220/435] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Aug 19 19:12:38 2022] GET /identity/v3/groups/71314a20dde7428db3dd15076e1eae84 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:39.009898 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d8a28-e4f0-4a98-bb0e-1d3e8ceb1bf2 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:39.062473 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:39.106804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8890755-eb63-4926-91b0-5939b97752fa None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:39.116822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d8a28-e4f0-4a98-bb0e-1d3e8ceb1bf2 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:39.142413 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4aa83-fea8-4a06-a98b-11b3c5b3749f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:39.143045 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4aa83-fea8-4a06-a98b-11b3c5b3749f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:39.143322 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4aa83-fea8-4a06-a98b-11b3c5b3749f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:39.143593 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4aa83-fea8-4a06-a98b-11b3c5b3749f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:39.153466 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2aa3fe-5de8-409d-a01a-f83eec56c157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:39.154060 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2aa3fe-5de8-409d-a01a-f83eec56c157 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:39.154336 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2aa3fe-5de8-409d-a01a-f83eec56c157 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:39.154634 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2aa3fe-5de8-409d-a01a-f83eec56c157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:39.155353 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2aa3fe-5de8-409d-a01a-f83eec56c157 None admin] RBAC: Adding query filter params (group.id=71314a20dde7428db3dd15076e1eae84, role.id=097319c04e61414e80385247dbf5003a, scope.project.id=91bbd1bb0efc40338fac7e525cc596d1) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:39.155656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2aa3fe-5de8-409d-a01a-f83eec56c157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:39.157116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2aa3fe-5de8-409d-a01a-f83eec56c157 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:39.162801 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 221/436] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Aug 19 19:12:39 2022] GET /identity/v3/role_assignments?group.id=71314a20dde7428db3dd15076e1eae84&scope.project.id=91bbd1bb0efc40338fac7e525cc596d1&role.id=097319c04e61414e80385247dbf5003a => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:39.163605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2aa3fe-5de8-409d-a01a-f83eec56c157 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:39.187700 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:39.234745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4aa83-fea8-4a06-a98b-11b3c5b3749f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:39.236284 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4aa83-fea8-4a06-a98b-11b3c5b3749f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:39.290867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2aa3fe-5de8-409d-a01a-f83eec56c157 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:39.308386 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:39.332704 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1583f3-b821-4905-8be6-4522e1556652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:39.333254 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1583f3-b821-4905-8be6-4522e1556652 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:39.333531 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1583f3-b821-4905-8be6-4522e1556652 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:39.333799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1583f3-b821-4905-8be6-4522e1556652 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:39.334552 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1583f3-b821-4905-8be6-4522e1556652 None admin] RBAC: Adding query filter params (group.id=71314a20dde7428db3dd15076e1eae84, role.id=83a904d35afc48fe9f8d55c0fd1597d8, scope.project.id=91bbd1bb0efc40338fac7e525cc596d1) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:39.334865 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1583f3-b821-4905-8be6-4522e1556652 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:39.336321 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1583f3-b821-4905-8be6-4522e1556652 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:39.343535 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 222/437] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Aug 19 19:12:39 2022] GET /identity/v3/role_assignments?group.id=71314a20dde7428db3dd15076e1eae84&scope.project.id=91bbd1bb0efc40338fac7e525cc596d1&role.id=83a904d35afc48fe9f8d55c0fd1597d8 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:39.356110 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfde47-b75a-4f8f-afef-7272c565b8fb None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:39.356388 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfde47-b75a-4f8f-afef-7272c565b8fb None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:39.356664 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfde47-b75a-4f8f-afef-7272c565b8fb None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:39.357982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 223/438] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:39 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:39.358706 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfde47-b75a-4f8f-afef-7272c565b8fb None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:39.361013 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 216/439] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:39.364172 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f8b7c-3995-4d87-addc-1c57293e57c6 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:39.364973 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f8b7c-3995-4d87-addc-1c57293e57c6 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:39.364973 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f8b7c-3995-4d87-addc-1c57293e57c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:39.388982 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-e64f8b7c-3995-4d87-addc-1c57293e57c6 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:39.390361 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e64f8b7c-3995-4d87-addc-1c57293e57c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:39.470660 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:39.478673 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 217/440] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:12:39.484327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f8b7c-3995-4d87-addc-1c57293e57c6 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:39.503840 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfde47-b75a-4f8f-afef-7272c565b8fb None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:39.545515 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934741a-c0d2-4e60-b871-c28aaa6bc1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:39.546736 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934741a-c0d2-4e60-b871-c28aaa6bc1b7 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:39.547244 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934741a-c0d2-4e60-b871-c28aaa6bc1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:39.547711 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934741a-c0d2-4e60-b871-c28aaa6bc1b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:39.564324 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934741a-c0d2-4e60-b871-c28aaa6bc1b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:39.571834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-8934741a-c0d2-4e60-b871-c28aaa6bc1b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:12:39.571834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:39.571834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:39.571834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:39.571834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:39.571834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:39.571834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:39.571834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:39.571834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:39.571834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:39.571834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:39.571834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:39.571834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:39.571834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:39.571834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:39.571834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:39.572717 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:39.572717 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:39.572717 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:39.572717 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:39.572717 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:39.572717 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:39.572717 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:39.572717 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:39.572717 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:39.572717 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:39.572717 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:39.572717 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:39.572717 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:39.572717 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:39.572717 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:39.572717 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:39.573719 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:39.573719 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:39.573719 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:39.573719 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:39.573719 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:39.573719 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:39.573719 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:39.573719 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:39.573719 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:39.573719 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:39.573719 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 19:12:39.573719 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:39.576008 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 224/441] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:12:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:39.582804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934741a-c0d2-4e60-b871-c28aaa6bc1b7 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:39.608350 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:39.625346 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f8b7c-3995-4d87-addc-1c57293e57c6 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:39.678240 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffbdec-0550-4e93-b7b5-86300d60ab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:39.679026 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffbdec-0550-4e93-b7b5-86300d60ab06 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:39.679301 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffbdec-0550-4e93-b7b5-86300d60ab06 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:39.679568 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffbdec-0550-4e93-b7b5-86300d60ab06 None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:39.681253 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffbdec-0550-4e93-b7b5-86300d60ab06 None admin] RBAC: Authorizing `identity:get_project(project_id=35715c28855e4d0b93c644f5a3804760)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:39.683041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffbdec-0550-4e93-b7b5-86300d60ab06 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:39.684509 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 218/442] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:39 2022] GET /identity/v3/projects/35715c28855e4d0b93c644f5a3804760 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:39.689905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffbdec-0550-4e93-b7b5-86300d60ab06 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:39.728497 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934741a-c0d2-4e60-b871-c28aaa6bc1b7 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:39.773010 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f78cf2-d719-42e7-a394-ed554aac2e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:39.773623 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f78cf2-d719-42e7-a394-ed554aac2e5e None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:39.773905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f78cf2-d719-42e7-a394-ed554aac2e5e None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:39.774180 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f78cf2-d719-42e7-a394-ed554aac2e5e None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:39.775287 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f78cf2-d719-42e7-a394-ed554aac2e5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:39.775657 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f78cf2-d719-42e7-a394-ed554aac2e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:39.777048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f78cf2-d719-42e7-a394-ed554aac2e5e None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:39.783537 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:39.786802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 225/443] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:12:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:39.793537 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f78cf2-d719-42e7-a394-ed554aac2e5e None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:39.817402 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffbdec-0550-4e93-b7b5-86300d60ab06 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:39.858005 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e087412-e251-4d99-9843-eb994a8e08ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:39.858619 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e087412-e251-4d99-9843-eb994a8e08ae None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:39.858865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e087412-e251-4d99-9843-eb994a8e08ae None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:39.859298 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e087412-e251-4d99-9843-eb994a8e08ae None admin] PATH_INFO: `/v3/groups/71314a20dde7428db3dd15076e1eae84` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:39.860503 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e087412-e251-4d99-9843-eb994a8e08ae None admin] RBAC: Authorizing `identity:get_group(group_id=71314a20dde7428db3dd15076e1eae84)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:39.862037 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e087412-e251-4d99-9843-eb994a8e08ae None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:39.863719 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 219/444] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Aug 19 19:12:39 2022] GET /identity/v3/groups/71314a20dde7428db3dd15076e1eae84 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:39.864928 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e087412-e251-4d99-9843-eb994a8e08ae None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:39.894895 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:39.918768 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f78cf2-d719-42e7-a394-ed554aac2e5e None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:39.964090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a866a-27de-4203-b13f-716ee94bdf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:39.964699 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a866a-27de-4203-b13f-716ee94bdf0e None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:39.964966 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a866a-27de-4203-b13f-716ee94bdf0e None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:39.965241 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a866a-27de-4203-b13f-716ee94bdf0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:39.989685 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e087412-e251-4d99-9843-eb994a8e08ae None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:40.028360 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918f633-8a55-47d3-a674-88a8d60315f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:40.028992 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f633-8a55-47d3-a674-88a8d60315f8 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:40.029278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f633-8a55-47d3-a674-88a8d60315f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:40.029573 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f633-8a55-47d3-a674-88a8d60315f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:40.041213 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918f633-8a55-47d3-a674-88a8d60315f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:40.043513 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:40.045964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-c918f633-8a55-47d3-a674-88a8d60315f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:12:40.045964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:40.045964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:40.045964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:40.045964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:40.045964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:40.045964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:40.045964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:40.045964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:40.045964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:40.045964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:40.045964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:40.045964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:40.045964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:40.045964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:40.045964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:40.046888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:40.046888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:40.046888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:40.046888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:40.046888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:40.046888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:40.046888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:40.046888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:40.046888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:40.046888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:40.046888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:40.046888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:40.046888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:40.046888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:40.046888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:40.046888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:40.047668 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:40.047668 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:40.047668 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:40.047668 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:40.047668 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:40.047668 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:40.047668 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:40.047668 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:40.047668 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:40.047668 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:40.047668 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:12:40.047668 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:40.048784 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a866a-27de-4203-b13f-716ee94bdf0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:40.048864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 220/445] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Aug 19 19:12:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:40.048864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918f633-8a55-47d3-a674-88a8d60315f8 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:40.049038 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a866a-27de-4203-b13f-716ee94bdf0e None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:40.135600 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:40.150305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 226/446] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 19:12:40.155266 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918f633-8a55-47d3-a674-88a8d60315f8 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:40.155387 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a866a-27de-4203-b13f-716ee94bdf0e None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:40.187301 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f3a3c-eebb-42f2-a186-69096ac46884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:40.187830 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f3a3c-eebb-42f2-a186-69096ac46884 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:40.188101 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f3a3c-eebb-42f2-a186-69096ac46884 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:40.188371 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f3a3c-eebb-42f2-a186-69096ac46884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:40.189078 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f3a3c-eebb-42f2-a186-69096ac46884 None admin] RBAC: Adding query filter params (group.id=71314a20dde7428db3dd15076e1eae84, role.id=83a904d35afc48fe9f8d55c0fd1597d8, scope.project.id=35715c28855e4d0b93c644f5a3804760) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:40.189377 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f3a3c-eebb-42f2-a186-69096ac46884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:40.190818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f3a3c-eebb-42f2-a186-69096ac46884 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:40.197785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 221/447] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Aug 19 19:12:40 2022] GET /identity/v3/role_assignments?group.id=71314a20dde7428db3dd15076e1eae84&scope.project.id=35715c28855e4d0b93c644f5a3804760&role.id=83a904d35afc48fe9f8d55c0fd1597d8 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:40.198409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f3a3c-eebb-42f2-a186-69096ac46884 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:40.266890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:40.270834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a866a-27de-4203-b13f-716ee94bdf0e None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:40.309006 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cad62a-f074-4a47-b37f-5a3ae99dd13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:40.309622 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cad62a-f074-4a47-b37f-5a3ae99dd13c None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:40.309900 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cad62a-f074-4a47-b37f-5a3ae99dd13c None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:40.310168 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cad62a-f074-4a47-b37f-5a3ae99dd13c None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:40.310889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cad62a-f074-4a47-b37f-5a3ae99dd13c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:40.311193 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cad62a-f074-4a47-b37f-5a3ae99dd13c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:40.312593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cad62a-f074-4a47-b37f-5a3ae99dd13c None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:40.314826 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f3a3c-eebb-42f2-a186-69096ac46884 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:40.323702 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 227/448] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:40.329096 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cad62a-f074-4a47-b37f-5a3ae99dd13c None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:40.359034 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8e00e-548b-47f5-a17f-66f9c8c7cb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:40.359743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8e00e-548b-47f5-a17f-66f9c8c7cb5c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:40.360017 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8e00e-548b-47f5-a17f-66f9c8c7cb5c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:40.360292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8e00e-548b-47f5-a17f-66f9c8c7cb5c None admin] PATH_INFO: `/v3/projects/35715c28855e4d0b93c644f5a3804760` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:40.361467 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8e00e-548b-47f5-a17f-66f9c8c7cb5c None admin] RBAC: Authorizing `identity:get_project(project_id=35715c28855e4d0b93c644f5a3804760)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:40.362972 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8e00e-548b-47f5-a17f-66f9c8c7cb5c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:40.364934 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 222/449] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:40 2022] GET /identity/v3/projects/35715c28855e4d0b93c644f5a3804760 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:40.370717 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8e00e-548b-47f5-a17f-66f9c8c7cb5c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:40.391963 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:40.459168 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cad62a-f074-4a47-b37f-5a3ae99dd13c None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:40.498516 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8e00e-548b-47f5-a17f-66f9c8c7cb5c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:40.503221 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a55a8c-971f-48a1-8561-6970eb3a0692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:40.503828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a55a8c-971f-48a1-8561-6970eb3a0692 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:40.504104 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a55a8c-971f-48a1-8561-6970eb3a0692 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:40.505069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a55a8c-971f-48a1-8561-6970eb3a0692 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:40.535591 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:40.544029 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602ab05-d903-4c86-af36-e76808b83ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:40.544682 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602ab05-d903-4c86-af36-e76808b83ec7 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:40.545339 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602ab05-d903-4c86-af36-e76808b83ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:40.545339 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602ab05-d903-4c86-af36-e76808b83ec7 None admin] PATH_INFO: `/v3/groups/71314a20dde7428db3dd15076e1eae84` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:40.546688 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602ab05-d903-4c86-af36-e76808b83ec7 None admin] RBAC: Authorizing `identity:get_group(group_id=71314a20dde7428db3dd15076e1eae84)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:40.547838 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602ab05-d903-4c86-af36-e76808b83ec7 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:40.549423 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 223/450] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Aug 19 19:12:40 2022] GET /identity/v3/groups/71314a20dde7428db3dd15076e1eae84 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:40.555462 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602ab05-d903-4c86-af36-e76808b83ec7 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:40.583909 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a55a8c-971f-48a1-8561-6970eb3a0692 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:40.585450 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a55a8c-971f-48a1-8561-6970eb3a0692 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:40.651606 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:40.666333 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602ab05-d903-4c86-af36-e76808b83ec7 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:40.688437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 228/451] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 19:12:40.697276 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a55a8c-971f-48a1-8561-6970eb3a0692 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:40.702463 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acced771-4b2e-4249-beeb-892304974fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:40.703220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acced771-4b2e-4249-beeb-892304974fea None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:40.703490 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acced771-4b2e-4249-beeb-892304974fea None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:40.703756 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acced771-4b2e-4249-beeb-892304974fea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:40.704475 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acced771-4b2e-4249-beeb-892304974fea None admin] RBAC: Adding query filter params (group.id=71314a20dde7428db3dd15076e1eae84, role.id=097319c04e61414e80385247dbf5003a, scope.project.id=35715c28855e4d0b93c644f5a3804760) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:40.704778 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acced771-4b2e-4249-beeb-892304974fea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:40.706203 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acced771-4b2e-4249-beeb-892304974fea None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:40.712704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 224/452] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Aug 19 19:12:40 2022] GET /identity/v3/role_assignments?group.id=71314a20dde7428db3dd15076e1eae84&scope.project.id=35715c28855e4d0b93c644f5a3804760&role.id=097319c04e61414e80385247dbf5003a => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:40.762954 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:40.808655 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a55a8c-971f-48a1-8561-6970eb3a0692 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:40.845646 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d41764-3356-4ff8-8e90-5e96626b480d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:40.846279 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d41764-3356-4ff8-8e90-5e96626b480d None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:40.846670 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d41764-3356-4ff8-8e90-5e96626b480d None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:40.846933 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d41764-3356-4ff8-8e90-5e96626b480d None admin] PATH_INFO: `/v3/projects/1351328a9fb54f3696993b85a91b70f8` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:40.848007 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d41764-3356-4ff8-8e90-5e96626b480d None admin] RBAC: Authorizing `identity:get_project(project_id=1351328a9fb54f3696993b85a91b70f8)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:40.849478 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d41764-3356-4ff8-8e90-5e96626b480d None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:40.851187 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 229/453] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Aug 19 19:12:40 2022] GET /identity/v3/projects/1351328a9fb54f3696993b85a91b70f8 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:40.857919 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acced771-4b2e-4249-beeb-892304974fea None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:40.963992 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acced771-4b2e-4249-beeb-892304974fea None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:40.998571 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae569f8-f4f4-4cc4-847e-738fffcaa0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:40.999179 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae569f8-f4f4-4cc4-847e-738fffcaa0a1 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:40.999462 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae569f8-f4f4-4cc4-847e-738fffcaa0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:40.999732 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae569f8-f4f4-4cc4-847e-738fffcaa0a1 None admin] PATH_INFO: `/v3/groups/37d00f4392004ba097a8e48f1cb90d50` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:41.000849 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae569f8-f4f4-4cc4-847e-738fffcaa0a1 None admin] RBAC: Authorizing `identity:get_group(group_id=37d00f4392004ba097a8e48f1cb90d50)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:41.002280 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae569f8-f4f4-4cc4-847e-738fffcaa0a1 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:41.003886 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 225/454] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Aug 19 19:12:40 2022] GET /identity/v3/groups/37d00f4392004ba097a8e48f1cb90d50 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:41.010613 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d41764-3356-4ff8-8e90-5e96626b480d None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:41.120254 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d41764-3356-4ff8-8e90-5e96626b480d None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:41.146066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:41.154416 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c4fe3-42aa-466c-8285-3d5c7132a8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:41.155032 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c4fe3-42aa-466c-8285-3d5c7132a8e0 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:41.155305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c4fe3-42aa-466c-8285-3d5c7132a8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:41.155569 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c4fe3-42aa-466c-8285-3d5c7132a8e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:41.156277 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c4fe3-42aa-466c-8285-3d5c7132a8e0 None admin] RBAC: Adding query filter params (group.id=37d00f4392004ba097a8e48f1cb90d50, role.id=8fdfbc4aaf68468f89a5ae3450b8488d, scope.project.id=1351328a9fb54f3696993b85a91b70f8) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:41.156576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c4fe3-42aa-466c-8285-3d5c7132a8e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:41.158058 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c4fe3-42aa-466c-8285-3d5c7132a8e0 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:41.163692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 230/455] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Aug 19 19:12:41 2022] GET /identity/v3/role_assignments?group.id=37d00f4392004ba097a8e48f1cb90d50&scope.project.id=1351328a9fb54f3696993b85a91b70f8&role.id=8fdfbc4aaf68468f89a5ae3450b8488d => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:43.785028 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af48d57-f594-4d14-9fb0-550c9e6fde9e None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:43.785544 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af48d57-f594-4d14-9fb0-550c9e6fde9e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:43.785619 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af48d57-f594-4d14-9fb0-550c9e6fde9e None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:43.787280 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 226/456] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:43.792922 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c80162-5323-4186-b147-f8e6e958b675 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:43.793779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c80162-5323-4186-b147-f8e6e958b675 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:43.794252 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c80162-5323-4186-b147-f8e6e958b675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:43.814506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-21c80162-5323-4186-b147-f8e6e958b675 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:43.815781 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-21c80162-5323-4186-b147-f8e6e958b675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:43.891156 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 231/457] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:43.984508 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824f778-b80c-45cb-a412-bda664bf30b8 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:43.984947 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824f778-b80c-45cb-a412-bda664bf30b8 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:43.985347 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824f778-b80c-45cb-a412-bda664bf30b8 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:43.987323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 227/458] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:43.993872 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7d4b6-2bd2-4900-8e73-ff827404aece None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:43.994300 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7d4b6-2bd2-4900-8e73-ff827404aece None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:43.994725 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7d4b6-2bd2-4900-8e73-ff827404aece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:44.014645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-32f7d4b6-2bd2-4900-8e73-ff827404aece None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:44.015871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-32f7d4b6-2bd2-4900-8e73-ff827404aece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:44.087938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 232/459] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:44.140209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643be2d4-31f0-4109-97f8-c7b7c62b4afc None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:44.140529 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643be2d4-31f0-4109-97f8-c7b7c62b4afc None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:44.140759 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643be2d4-31f0-4109-97f8-c7b7c62b4afc None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:44.150870 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 228/460] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:44.151007 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ca9ed-63f6-40f3-98ee-c5933c856a7c None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:44.151007 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ca9ed-63f6-40f3-98ee-c5933c856a7c None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:44.151007 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ca9ed-63f6-40f3-98ee-c5933c856a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:44.166581 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-eb1ca9ed-63f6-40f3-98ee-c5933c856a7c None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:44.167767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-eb1ca9ed-63f6-40f3-98ee-c5933c856a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:44.221253 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:44.230456 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643be2d4-31f0-4109-97f8-c7b7c62b4afc None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:44.244812 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 233/461] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:44.258927 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:44.352822 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643be2d4-31f0-4109-97f8-c7b7c62b4afc None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:44.390550 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a9bbd-54d1-439f-b57e-991b5e243c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:44.391186 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a9bbd-54d1-439f-b57e-991b5e243c93 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:44.391459 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a9bbd-54d1-439f-b57e-991b5e243c93 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:44.391729 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a9bbd-54d1-439f-b57e-991b5e243c93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:44.402942 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a9bbd-54d1-439f-b57e-991b5e243c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:44.404327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a9bbd-54d1-439f-b57e-991b5e243c93 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:44.423806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-834a9bbd-54d1-439f-b57e-991b5e243c93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:44.423806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:44.423806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:44.423806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:44.423806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:44.423806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:44.423806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:44.423806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:44.423806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:44.423806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:44.423806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:44.423806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:44.423806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:44.423806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:44.423806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:44.423806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:44.424766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:44.424766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:44.424766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:44.424766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:44.424766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:44.424766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:44.424766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:44.424766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:44.424766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:44.424766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:44.424766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:44.424766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:44.424766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:44.424766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:44.424766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:44.424766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:44.424766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:44.425622 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:44.425622 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:44.425622 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:44.425622 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 229/462] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:12:44.435826 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ca9ed-63f6-40f3-98ee-c5933c856a7c None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:44.449274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a9bbd-54d1-439f-b57e-991b5e243c93 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:44.535710 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:44.566120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ca9ed-63f6-40f3-98ee-c5933c856a7c None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:44.571949 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a9bbd-54d1-439f-b57e-991b5e243c93 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:44.605738 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a585c19-e65a-4958-8d59-963a724cb158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:44.606344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a585c19-e65a-4958-8d59-963a724cb158 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:44.606654 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a585c19-e65a-4958-8d59-963a724cb158 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:44.606932 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a585c19-e65a-4958-8d59-963a724cb158 None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:44.607569 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a585c19-e65a-4958-8d59-963a724cb158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:44.607871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a585c19-e65a-4958-8d59-963a724cb158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:44.608473 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6398a5a-c48b-4975-b22d-38cedfc6ee5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:44.609097 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6398a5a-c48b-4975-b22d-38cedfc6ee5c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:44.609237 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a585c19-e65a-4958-8d59-963a724cb158 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:44.609370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6398a5a-c48b-4975-b22d-38cedfc6ee5c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:44.609635 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6398a5a-c48b-4975-b22d-38cedfc6ee5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:44.620527 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6398a5a-c48b-4975-b22d-38cedfc6ee5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:44.620995 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 234/463] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:44.621967 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6398a5a-c48b-4975-b22d-38cedfc6ee5c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:44.622078 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d140b3-9eec-43e3-8c10-d8f14dca2d42 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:44.622352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d140b3-9eec-43e3-8c10-d8f14dca2d42 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:44.622594 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d140b3-9eec-43e3-8c10-d8f14dca2d42 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:44.623775 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 235/464] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:44.624462 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d140b3-9eec-43e3-8c10-d8f14dca2d42 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:44.638686 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-b6398a5a-c48b-4975-b22d-38cedfc6ee5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:44.638686 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:44.638686 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:44.638686 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:44.638686 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:44.638686 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:44.638686 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:44.638686 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:44.638686 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:44.638686 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:44.638686 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:44.638686 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:44.638686 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:44.638686 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:44.638686 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:44.638686 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:44.641374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:44.641374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:44.641374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:44.641374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:44.641374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:44.641374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:44.641374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:44.641374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:44.641374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:44.641374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:44.641374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:44.641374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:44.641374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:44.641374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:44.641374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:44.641374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:44.641374 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:44.642268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:44.642268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:44.642268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:44.642268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 230/465] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:12:44.642268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6398a5a-c48b-4975-b22d-38cedfc6ee5c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:44.671085 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:44.751851 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d140b3-9eec-43e3-8c10-d8f14dca2d42 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:44.758108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6398a5a-c48b-4975-b22d-38cedfc6ee5c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:44.781865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:44.786215 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3df5a7-79d6-488c-b74a-6e4425a42886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:44.786862 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3df5a7-79d6-488c-b74a-6e4425a42886 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:44.787140 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3df5a7-79d6-488c-b74a-6e4425a42886 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:44.787406 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3df5a7-79d6-488c-b74a-6e4425a42886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:44.792793 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6eeb9-f5c2-41db-931e-26f1b5e2f8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:44.793397 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6eeb9-f5c2-41db-931e-26f1b5e2f8ff None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:44.793671 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6eeb9-f5c2-41db-931e-26f1b5e2f8ff None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:44.793940 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6eeb9-f5c2-41db-931e-26f1b5e2f8ff None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:44.794584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6eeb9-f5c2-41db-931e-26f1b5e2f8ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:44.796058 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6eeb9-f5c2-41db-931e-26f1b5e2f8ff None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:44.797982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3df5a7-79d6-488c-b74a-6e4425a42886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:44.799442 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3df5a7-79d6-488c-b74a-6e4425a42886 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:44.814164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-8e3df5a7-79d6-488c-b74a-6e4425a42886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:44.814164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:44.814164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:44.814164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:44.814164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:44.814164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:44.814164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:44.814164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:44.814164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:44.814164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:44.814164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:44.814164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:44.814164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:44.814164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:44.814164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:44.814164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:44.824612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:44.824612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:44.824612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:44.824612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:44.824612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:44.824612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:44.824612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:44.824612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:44.824612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:44.824612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:44.824612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:44.824612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:44.824612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:44.824612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:44.824612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:44.824612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:44.824612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:44.825658 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:44.825658 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:44.825658 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:44.825658 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 236/466] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:44.825658 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f66a7f-5ee6-49c8-a3ed-4dc4d3113c7c None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:44.825658 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f66a7f-5ee6-49c8-a3ed-4dc4d3113c7c None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:44.825658 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f66a7f-5ee6-49c8-a3ed-4dc4d3113c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:44.835451 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-f1f66a7f-5ee6-49c8-a3ed-4dc4d3113c7c None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:44.836636 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-f1f66a7f-5ee6-49c8-a3ed-4dc4d3113c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:44.900572 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 231/467] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Aug 19 19:12:44 2022] POST /identity/v3/users => generated 246 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:12:44.901406 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6eeb9-f5c2-41db-931e-26f1b5e2f8ff None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:44.910103 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 237/468] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:44.912152 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f66a7f-5ee6-49c8-a3ed-4dc4d3113c7c None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:44.974827 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:45.054042 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6eeb9-f5c2-41db-931e-26f1b5e2f8ff None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:45.084440 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f66a7f-5ee6-49c8-a3ed-4dc4d3113c7c None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:45.104610 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3684c-76e9-4cad-a648-ff9f490fb64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:45.105232 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3684c-76e9-4cad-a648-ff9f490fb64c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:45.105507 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3684c-76e9-4cad-a648-ff9f490fb64c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:45.105780 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3684c-76e9-4cad-a648-ff9f490fb64c None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:45.106430 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3684c-76e9-4cad-a648-ff9f490fb64c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:45.106765 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3684c-76e9-4cad-a648-ff9f490fb64c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:45.108161 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3684c-76e9-4cad-a648-ff9f490fb64c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:45.123892 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 232/469] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:45.130002 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3684c-76e9-4cad-a648-ff9f490fb64c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:45.132906 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04d7ab-62b5-4927-844e-6458c6d8fd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:45.133808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04d7ab-62b5-4927-844e-6458c6d8fd90 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:45.134095 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04d7ab-62b5-4927-844e-6458c6d8fd90 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:45.134363 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04d7ab-62b5-4927-844e-6458c6d8fd90 None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:45.135041 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04d7ab-62b5-4927-844e-6458c6d8fd90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:45.135340 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04d7ab-62b5-4927-844e-6458c6d8fd90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:45.136725 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04d7ab-62b5-4927-844e-6458c6d8fd90 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:45.157020 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 238/470] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:45.162277 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04d7ab-62b5-4927-844e-6458c6d8fd90 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:45.184730 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:45.269211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3684c-76e9-4cad-a648-ff9f490fb64c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:45.274787 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:45.291764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04d7ab-62b5-4927-844e-6458c6d8fd90 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:45.309763 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3eca41-ca59-4f4d-8e94-22875f20cdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:45.310369 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3eca41-ca59-4f4d-8e94-22875f20cdc8 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:45.310692 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3eca41-ca59-4f4d-8e94-22875f20cdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:45.310965 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3eca41-ca59-4f4d-8e94-22875f20cdc8 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:45.311607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3eca41-ca59-4f4d-8e94-22875f20cdc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:45.313073 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3eca41-ca59-4f4d-8e94-22875f20cdc8 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:45.329084 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55136bb8-f035-4e42-9506-f31cdc1173e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:45.329675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55136bb8-f035-4e42-9506-f31cdc1173e0 None admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:45.329951 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55136bb8-f035-4e42-9506-f31cdc1173e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:45.330218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55136bb8-f035-4e42-9506-f31cdc1173e0 None admin] PATH_INFO: `/v3/users` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:45.330889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55136bb8-f035-4e42-9506-f31cdc1173e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:45.332315 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55136bb8-f035-4e42-9506-f31cdc1173e0 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:45.449512 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 239/471] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Aug 19 19:12:45 2022] POST /identity/v3/users => generated 248 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:12:45.450417 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55136bb8-f035-4e42-9506-f31cdc1173e0 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:45.467393 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 233/472] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Aug 19 19:12:45 2022] POST /identity/v3/users => generated 248 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:12:45.597246 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55136bb8-f035-4e42-9506-f31cdc1173e0 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:45.638104 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d660323-1106-449c-bedb-4c861a314a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:45.638795 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d660323-1106-449c-bedb-4c861a314a82 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:45.639070 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d660323-1106-449c-bedb-4c861a314a82 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:45.639337 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d660323-1106-449c-bedb-4c861a314a82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:45.652248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:45.655042 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d660323-1106-449c-bedb-4c861a314a82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:45.656548 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d660323-1106-449c-bedb-4c861a314a82 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:45.671863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-5d660323-1106-449c-bedb-4c861a314a82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:45.671863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:45.671863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:45.671863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:45.671863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:45.671863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:45.671863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:45.671863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:45.671863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:45.671863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:45.671863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:45.671863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:45.671863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:45.671863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:45.671863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:45.671863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:45.672820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:45.672820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:45.672820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:45.672820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:45.672820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:45.672820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:45.672820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:45.672820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:45.672820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:45.672820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:45.672820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:45.672820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:45.672820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:45.672820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:45.672820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:45.672820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:45.672820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:45.673656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:45.673656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:45.673656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:45.673656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 240/473] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:45.679426 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3eca41-ca59-4f4d-8e94-22875f20cdc8 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:45.781119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:45.787732 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3eca41-ca59-4f4d-8e94-22875f20cdc8 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:45.822988 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27516dd-803e-4140-95ec-fcfb058144c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:45.823593 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27516dd-803e-4140-95ec-fcfb058144c2 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:45.823858 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27516dd-803e-4140-95ec-fcfb058144c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:45.824126 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27516dd-803e-4140-95ec-fcfb058144c2 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:45.824757 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27516dd-803e-4140-95ec-fcfb058144c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:45.825299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27516dd-803e-4140-95ec-fcfb058144c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:45.826930 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27516dd-803e-4140-95ec-fcfb058144c2 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:45.843743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 234/474] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:45.844872 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d660323-1106-449c-bedb-4c861a314a82 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:45.950134 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d660323-1106-449c-bedb-4c861a314a82 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:45.985838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a11b9-d775-41e4-872d-dedaed9477d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:45.986499 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a11b9-d775-41e4-872d-dedaed9477d0 None admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:45.986806 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a11b9-d775-41e4-872d-dedaed9477d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:45.987092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a11b9-d775-41e4-872d-dedaed9477d0 None admin] PATH_INFO: `/v3/users` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:45.987789 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a11b9-d775-41e4-872d-dedaed9477d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:45.989239 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a11b9-d775-41e4-872d-dedaed9477d0 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:46.069257 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 241/475] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Aug 19 19:12:45 2022] POST /identity/v3/users => generated 249 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:12:47.313993 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412b8de-f708-41a1-aab2-448e8d328fb9 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:47.314505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412b8de-f708-41a1-aab2-448e8d328fb9 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:47.314505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412b8de-f708-41a1-aab2-448e8d328fb9 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:47.316104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 235/476] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:47.322244 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd02fc-d26b-4209-b0e0-2e5a6ce675c4 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:47.323149 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd02fc-d26b-4209-b0e0-2e5a6ce675c4 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:47.323619 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd02fc-d26b-4209-b0e0-2e5a6ce675c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:47.342891 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-21bd02fc-d26b-4209-b0e0-2e5a6ce675c4 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:47.344431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-21bd02fc-d26b-4209-b0e0-2e5a6ce675c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:47.395931 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:47.420644 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 242/477] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:47.762483 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412b8de-f708-41a1-aab2-448e8d328fb9 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:47.876299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412b8de-f708-41a1-aab2-448e8d328fb9 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:47.892345 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd53292-1535-46bd-9454-eb947db846e0 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:47.892963 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd53292-1535-46bd-9454-eb947db846e0 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:47.893459 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd53292-1535-46bd-9454-eb947db846e0 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:47.895440 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 243/478] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:47.901334 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5b910-e9ac-41ca-b285-1d840fe22e61 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:47.901877 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5b910-e9ac-41ca-b285-1d840fe22e61 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:47.902346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5b910-e9ac-41ca-b285-1d840fe22e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:47.919346 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2f86b-8f8b-42b5-8520-adc9405c1554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:47.919995 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2f86b-8f8b-42b5-8520-adc9405c1554 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:47.920275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2f86b-8f8b-42b5-8520-adc9405c1554 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:47.920547 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2f86b-8f8b-42b5-8520-adc9405c1554 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:47.922072 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-aff5b910-e9ac-41ca-b285-1d840fe22e61 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:47.923545 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-aff5b910-e9ac-41ca-b285-1d840fe22e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:47.933582 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2f86b-8f8b-42b5-8520-adc9405c1554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:47.941139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-7ff2f86b-8f8b-42b5-8520-adc9405c1554 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:12:47.941139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:47.941139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:47.941139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:47.941139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:47.941139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:47.941139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:47.941139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:47.941139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:47.941139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:47.941139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:47.941139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:47.941139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:47.941139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:47.941139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:47.941139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:47.942323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:47.942323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:47.942323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:47.942323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:47.942323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:47.942323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:47.942323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:47.942323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:47.942323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:47.942323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:47.942323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:47.942323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:47.942323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:47.942323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:47.942323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:47.942323 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:47.943160 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:47.943160 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:47.943160 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:47.943160 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:47.943160 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:47.943160 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:47.943160 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:47.943160 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:47.943160 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:47.943160 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:47.943160 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:12:47.943160 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:47.943160 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 236/479] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Aug 19 19:12:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:47.949404 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2f86b-8f8b-42b5-8520-adc9405c1554 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:47.968711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:48.004249 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 244/480] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:12:48.005635 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4ed2b-0c25-408b-b759-a71be1443f09 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:48.005928 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4ed2b-0c25-408b-b759-a71be1443f09 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:48.006201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4ed2b-0c25-408b-b759-a71be1443f09 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:48.007572 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 245/481] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:48.012941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e3e51-b872-4d8f-8ced-d9c79439abd2 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:48.013226 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e3e51-b872-4d8f-8ced-d9c79439abd2 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:48.013499 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e3e51-b872-4d8f-8ced-d9c79439abd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:48.031148 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-298e3e51-b872-4d8f-8ced-d9c79439abd2 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:48.032465 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-298e3e51-b872-4d8f-8ced-d9c79439abd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:48.069921 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2f86b-8f8b-42b5-8520-adc9405c1554 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:48.115183 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 246/482] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:48.118925 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af63812-0cfa-46ca-aa35-2a869fea2726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:48.119820 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af63812-0cfa-46ca-aa35-2a869fea2726 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:48.120279 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af63812-0cfa-46ca-aa35-2a869fea2726 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:48.120797 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af63812-0cfa-46ca-aa35-2a869fea2726 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:48.121642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af63812-0cfa-46ca-aa35-2a869fea2726 None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:48.122122 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af63812-0cfa-46ca-aa35-2a869fea2726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:48.123712 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af63812-0cfa-46ca-aa35-2a869fea2726 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:48.132912 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 237/483] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Aug 19 19:12:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:12:48.142075 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e3e51-b872-4d8f-8ced-d9c79439abd2 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:48.184609 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:48.253025 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e3e51-b872-4d8f-8ced-d9c79439abd2 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:48.290013 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4d832-3b58-46f6-8055-222486e824a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:48.290734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4d832-3b58-46f6-8055-222486e824a6 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:48.291012 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4d832-3b58-46f6-8055-222486e824a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:48.291284 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4d832-3b58-46f6-8055-222486e824a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:48.302045 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4d832-3b58-46f6-8055-222486e824a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:48.303523 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4d832-3b58-46f6-8055-222486e824a6 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:48.319368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-7ca4d832-3b58-46f6-8055-222486e824a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:48.319368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:48.319368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:48.319368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:48.319368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:48.319368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:48.319368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:48.319368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:48.319368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:48.319368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:48.319368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:48.319368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:48.319368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:48.319368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:48.319368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:48.319368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:48.321344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:48.321344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:48.321344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:48.321344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:48.321344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:48.321344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:48.321344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:48.321344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:48.321344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:48.321344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:48.321344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:48.321344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:48.321344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:48.321344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:48.321344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:48.321344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:48.321344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:48.322252 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:48.322252 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:48.322252 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:48.322252 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 247/484] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:48.327633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af63812-0cfa-46ca-aa35-2a869fea2726 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:48.351495 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4d832-3b58-46f6-8055-222486e824a6 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:48.464395 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:48.479684 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:48.488811 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af63812-0cfa-46ca-aa35-2a869fea2726 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:48.489885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4d832-3b58-46f6-8055-222486e824a6 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:48.524389 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886808a-1285-4f5e-a1b2-8100484f6511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:48.524628 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5783ddf-399b-4e35-81db-769a3d68e94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:48.525007 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886808a-1285-4f5e-a1b2-8100484f6511 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:48.525099 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5783ddf-399b-4e35-81db-769a3d68e94d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:48.525285 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886808a-1285-4f5e-a1b2-8100484f6511 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:48.525370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5783ddf-399b-4e35-81db-769a3d68e94d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:48.525557 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886808a-1285-4f5e-a1b2-8100484f6511 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:48.525642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5783ddf-399b-4e35-81db-769a3d68e94d None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:48.526233 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5783ddf-399b-4e35-81db-769a3d68e94d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:48.526541 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5783ddf-399b-4e35-81db-769a3d68e94d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:48.527924 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5783ddf-399b-4e35-81db-769a3d68e94d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:48.536209 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886808a-1285-4f5e-a1b2-8100484f6511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:48.540268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 238/485] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:48.544818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8a77f-5cf5-4121-a20a-3a47a55dd910 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:48.544923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-b886808a-1285-4f5e-a1b2-8100484f6511 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:12:48.544923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:48.544923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:48.544923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:48.544923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:48.544923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:48.544923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:48.544923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:48.544923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:48.544923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:48.544923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:48.544923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:48.544923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:48.544923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:48.544923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:48.544923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:48.545822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:48.545822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:48.545822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:48.545822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:48.545822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:48.545822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:48.545822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:48.545822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:48.545822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:48.545822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:48.545822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:48.545822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:48.545822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:48.545822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:48.545822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:48.545822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:48.546661 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:48.546661 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:48.546661 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:48.546661 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:48.546661 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:48.546661 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:48.546661 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:48.546661 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:48.546661 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:48.546661 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:48.546661 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:12:48.546661 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:48.547271 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8a77f-5cf5-4121-a20a-3a47a55dd910 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:48.547271 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8a77f-5cf5-4121-a20a-3a47a55dd910 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:48.547389 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 248/486] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Aug 19 19:12:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:12:48.547452 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 239/487] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:48.547514 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886808a-1285-4f5e-a1b2-8100484f6511 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:48.548859 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8a77f-5cf5-4121-a20a-3a47a55dd910 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:48.651640 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886808a-1285-4f5e-a1b2-8100484f6511 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:48.653365 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8a77f-5cf5-4121-a20a-3a47a55dd910 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:48.685625 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11559757-f529-4d0e-8c61-5139479162ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:48.686295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11559757-f529-4d0e-8c61-5139479162ee None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:48.686516 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11559757-f529-4d0e-8c61-5139479162ee None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:48.686939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11559757-f529-4d0e-8c61-5139479162ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:48.687831 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5edc5-c8f7-4212-b343-1e6219000f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:48.688457 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5edc5-c8f7-4212-b343-1e6219000f41 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:48.688736 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5edc5-c8f7-4212-b343-1e6219000f41 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:48.689000 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5edc5-c8f7-4212-b343-1e6219000f41 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:48.691935 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:48.696482 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5edc5-c8f7-4212-b343-1e6219000f41 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:48.697933 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5edc5-c8f7-4212-b343-1e6219000f41 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:48.698681 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11559757-f529-4d0e-8c61-5139479162ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:48.703682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-11559757-f529-4d0e-8c61-5139479162ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:12:48.703682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:48.703682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:48.703682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:48.703682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:48.703682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:48.703682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:48.703682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:48.703682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:48.703682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:48.703682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:48.703682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:48.703682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:48.703682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:48.703682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:48.703682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:48.705527 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:48.705527 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:48.705527 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:48.705527 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:48.705527 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:48.705527 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:48.705527 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:48.705527 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:48.705527 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:48.705527 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:48.705527 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:48.705527 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:48.705527 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:48.705527 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:48.705527 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:48.705527 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:48.706333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:48.706333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:48.706333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:48.706333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:48.706333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:48.706333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:48.706333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:48.706333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:48.706333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:48.706333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:48.706333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:12:48.706333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:48.706333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 249/488] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Aug 19 19:12:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:48.706333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b52e4-039f-4929-bea9-7ac1b03d8d59 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:48.707085 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b52e4-039f-4929-bea9-7ac1b03d8d59 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:48.707085 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b52e4-039f-4929-bea9-7ac1b03d8d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:48.713260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-a2f5edc5-c8f7-4212-b343-1e6219000f41 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:12:48.713260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:48.713260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:48.713260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:48.713260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:48.713260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:48.713260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:48.713260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:48.713260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:48.713260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:48.713260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:48.713260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:48.713260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:12:48.713260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:12:48.713260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:12:48.713260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:12:48.714151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:48.714151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:48.714151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:12:48.714151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:12:48.714151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:12:48.714151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:12:48.714151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:48.714151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:48.714151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:48.714151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:48.714151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:48.714151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:48.714151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:48.714151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:48.714151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:48.714151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:48.714151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:48.714151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:48.716162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:48.716162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:48.716162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:12:48.716162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:12:48.716162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:12:48.716162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:12:48.716162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:12:48.716162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:12:48.716162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:12:48.716162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:48.716162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 240/489] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Aug 19 19:12:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:48.716162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5edc5-c8f7-4212-b343-1e6219000f41 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:48.726897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-523b52e4-039f-4929-bea9-7ac1b03d8d59 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:48.728635 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-523b52e4-039f-4929-bea9-7ac1b03d8d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:48.731459 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:48.800376 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 250/490] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:48.801221 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b52e4-039f-4929-bea9-7ac1b03d8d59 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:48.830842 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5edc5-c8f7-4212-b343-1e6219000f41 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:48.865738 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e81132-7787-4de6-aa9b-0ce715e39fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:48.866345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e81132-7787-4de6-aa9b-0ce715e39fea None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:48.866655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e81132-7787-4de6-aa9b-0ce715e39fea None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:48.866928 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e81132-7787-4de6-aa9b-0ce715e39fea None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:48.867583 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e81132-7787-4de6-aa9b-0ce715e39fea None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:48.868465 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e81132-7787-4de6-aa9b-0ce715e39fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:48.870070 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e81132-7787-4de6-aa9b-0ce715e39fea None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:48.878162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 241/491] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Aug 19 19:12:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:48.879086 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e81132-7787-4de6-aa9b-0ce715e39fea None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:48.918028 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b52e4-039f-4929-bea9-7ac1b03d8d59 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:48.942166 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:48.956493 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac7a28-88b8-466d-be84-987198513ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:48.957096 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac7a28-88b8-466d-be84-987198513ac2 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:48.957366 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac7a28-88b8-466d-be84-987198513ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:48.957633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac7a28-88b8-466d-be84-987198513ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:48.958282 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac7a28-88b8-466d-be84-987198513ac2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:48.958621 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac7a28-88b8-466d-be84-987198513ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:48.959989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac7a28-88b8-466d-be84-987198513ac2 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:48.968877 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 251/492] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Aug 19 19:12:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:48.969748 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac7a28-88b8-466d-be84-987198513ac2 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:48.972572 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:49.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e81132-7787-4de6-aa9b-0ce715e39fea None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:49.044283 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c47ca3-897d-4707-a1c6-3a83a0ba76c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:49.045448 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c47ca3-897d-4707-a1c6-3a83a0ba76c9 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:49.045899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c47ca3-897d-4707-a1c6-3a83a0ba76c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:49.046636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c47ca3-897d-4707-a1c6-3a83a0ba76c9 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:49.048390 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c47ca3-897d-4707-a1c6-3a83a0ba76c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:49.048875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c47ca3-897d-4707-a1c6-3a83a0ba76c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:49.050490 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c47ca3-897d-4707-a1c6-3a83a0ba76c9 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:49.080404 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac7a28-88b8-466d-be84-987198513ac2 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:49.100593 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 242/493] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Aug 19 19:12:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:49.100593 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c47ca3-897d-4707-a1c6-3a83a0ba76c9 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:49.125051 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c618c-adcb-4a8b-a3d7-f31eea4281f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:49.125794 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c618c-adcb-4a8b-a3d7-f31eea4281f5 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:49.126068 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c618c-adcb-4a8b-a3d7-f31eea4281f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:49.126332 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c618c-adcb-4a8b-a3d7-f31eea4281f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:49.138301 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c618c-adcb-4a8b-a3d7-f31eea4281f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:49.139830 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c618c-adcb-4a8b-a3d7-f31eea4281f5 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:49.154873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-c92c618c-adcb-4a8b-a3d7-f31eea4281f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:49.154873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:49.154873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:49.154873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:49.154873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:49.154873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:49.154873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:49.154873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:49.154873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:49.154873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:49.154873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:49.154873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:49.154873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:49.154873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:49.154873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:49.154873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:49.155808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:49.155808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:49.155808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:49.155808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:49.155808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:49.155808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:49.155808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:49.155808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:49.155808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:49.155808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:49.155808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:49.155808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:49.155808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:49.155808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:49.155808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:49.155808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:49.155808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:49.156869 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:49.156869 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:49.156869 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:49.156869 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 252/494] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:49.156869 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c618c-adcb-4a8b-a3d7-f31eea4281f5 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:49.209702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c47ca3-897d-4707-a1c6-3a83a0ba76c9 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:49.211079 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:49.226382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:49.248111 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a9515-c81b-4491-8d33-176f5a04c1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:49.248739 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a9515-c81b-4491-8d33-176f5a04c1b8 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:49.252307 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a9515-c81b-4491-8d33-176f5a04c1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:49.252307 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a9515-c81b-4491-8d33-176f5a04c1b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:49.259477 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c618c-adcb-4a8b-a3d7-f31eea4281f5 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:49.260982 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a9515-c81b-4491-8d33-176f5a04c1b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:49.262438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a9515-c81b-4491-8d33-176f5a04c1b8 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:49.277421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-f71a9515-c81b-4491-8d33-176f5a04c1b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:49.277421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:49.277421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:49.277421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:49.277421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:49.277421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:49.277421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:49.277421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:49.277421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:49.277421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:49.277421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:49.277421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:49.277421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:49.277421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:49.277421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:49.277421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:49.278327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:49.278327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:49.278327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:49.278327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:49.278327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:49.278327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:49.278327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:49.278327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:49.278327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:49.278327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:49.278327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:49.278327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:49.278327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:49.278327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:49.278327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:49.278327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:49.278327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:49.279212 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:49.279212 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:49.279212 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:49.279212 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 243/495] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:49.279434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a9515-c81b-4491-8d33-176f5a04c1b8 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:49.294369 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53cdb0-6e56-4d42-96a4-4623ee581f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:49.294998 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53cdb0-6e56-4d42-96a4-4623ee581f98 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:49.295277 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53cdb0-6e56-4d42-96a4-4623ee581f98 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:49.295550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53cdb0-6e56-4d42-96a4-4623ee581f98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:49.362843 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53cdb0-6e56-4d42-96a4-4623ee581f98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:49.364310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53cdb0-6e56-4d42-96a4-4623ee581f98 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:49.379875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a9515-c81b-4491-8d33-176f5a04c1b8 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:49.413991 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33baa0-69a1-426e-aca3-1b9b4c8199a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:49.415218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33baa0-69a1-426e-aca3-1b9b4c8199a5 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:49.415501 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33baa0-69a1-426e-aca3-1b9b4c8199a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:49.415774 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33baa0-69a1-426e-aca3-1b9b4c8199a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:49.418887 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:49.428198 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33baa0-69a1-426e-aca3-1b9b4c8199a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:49.434554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-fc33baa0-69a1-426e-aca3-1b9b4c8199a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:12:49.434554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:49.434554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:49.434554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:49.434554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:49.434554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:49.434554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:49.434554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:49.434554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:49.434554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:49.434554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:49.434554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:49.434554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:49.434554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:49.434554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:49.434554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:49.436302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:49.436302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:49.436302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:49.436302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:49.436302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:49.436302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:49.436302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:49.436302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:49.436302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:49.436302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:49.436302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:49.436302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:49.436302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:49.436302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:49.436302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:49.436302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:49.437835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:49.437835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:49.437835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:49.437835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:49.437835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:49.437835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:49.437835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:49.437835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:49.437835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:49.437835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:49.437835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:12:49.437835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:49.437835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 244/496] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Aug 19 19:12:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:49.437835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33baa0-69a1-426e-aca3-1b9b4c8199a5 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:49.467662 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:49.469359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 253/497] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:49.470220 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53cdb0-6e56-4d42-96a4-4623ee581f98 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:49.538667 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33baa0-69a1-426e-aca3-1b9b4c8199a5 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:49.568646 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53cdb0-6e56-4d42-96a4-4623ee581f98 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:49.573387 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bb965-8efb-4522-a33f-e825b09108af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:49.573993 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bb965-8efb-4522-a33f-e825b09108af None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:49.574269 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bb965-8efb-4522-a33f-e825b09108af None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:49.574559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bb965-8efb-4522-a33f-e825b09108af None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:49.575663 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bb965-8efb-4522-a33f-e825b09108af None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:49.575663 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bb965-8efb-4522-a33f-e825b09108af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:49.576845 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bb965-8efb-4522-a33f-e825b09108af None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:49.588116 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 245/498] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:49.588914 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bb965-8efb-4522-a33f-e825b09108af None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:49.607162 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f9066-7d3f-4d0f-9003-6fd1f942cc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:49.607758 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f9066-7d3f-4d0f-9003-6fd1f942cc7f None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:49.608034 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f9066-7d3f-4d0f-9003-6fd1f942cc7f None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:49.608304 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f9066-7d3f-4d0f-9003-6fd1f942cc7f None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:49.608934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f9066-7d3f-4d0f-9003-6fd1f942cc7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:49.609241 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f9066-7d3f-4d0f-9003-6fd1f942cc7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:49.610644 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f9066-7d3f-4d0f-9003-6fd1f942cc7f None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:49.621835 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 254/499] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:49.622465 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f9066-7d3f-4d0f-9003-6fd1f942cc7f None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:49.638804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:49.679759 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:49.692288 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bb965-8efb-4522-a33f-e825b09108af None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:49.723856 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f9066-7d3f-4d0f-9003-6fd1f942cc7f None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:49.725874 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358c859-4c72-45c7-92bf-0cef80e40923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:49.727184 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358c859-4c72-45c7-92bf-0cef80e40923 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:49.727522 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358c859-4c72-45c7-92bf-0cef80e40923 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:49.727814 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358c859-4c72-45c7-92bf-0cef80e40923 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:49.728485 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358c859-4c72-45c7-92bf-0cef80e40923 None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:49.728796 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358c859-4c72-45c7-92bf-0cef80e40923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:49.730172 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358c859-4c72-45c7-92bf-0cef80e40923 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:49.738136 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 246/500] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Aug 19 19:12:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:49.743885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358c859-4c72-45c7-92bf-0cef80e40923 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:49.757582 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7567623-2cd5-4537-9d22-939f3c8d4c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:49.758203 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7567623-2cd5-4537-9d22-939f3c8d4c8f None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:49.759083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7567623-2cd5-4537-9d22-939f3c8d4c8f None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:49.759359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7567623-2cd5-4537-9d22-939f3c8d4c8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:49.769775 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7567623-2cd5-4537-9d22-939f3c8d4c8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:49.771248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7567623-2cd5-4537-9d22-939f3c8d4c8f None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:49.785904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-f7567623-2cd5-4537-9d22-939f3c8d4c8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:49.785904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:49.785904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:49.785904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:49.785904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:49.785904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:49.785904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:49.785904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:49.785904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:49.785904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:49.785904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:49.785904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:49.785904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:49.785904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:49.785904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:49.785904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:49.786885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:49.786885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:49.786885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:49.786885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:49.786885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:49.786885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:49.786885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:49.786885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:49.786885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:49.786885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:49.786885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:49.786885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:49.786885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:49.786885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:49.786885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:49.786885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:49.786885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:49.787761 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:49.787761 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:49.787761 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:49.787761 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 255/501] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:49.787761 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7567623-2cd5-4537-9d22-939f3c8d4c8f None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:49.847309 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358c859-4c72-45c7-92bf-0cef80e40923 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:49.854739 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:49.880046 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe0b63-77e5-4050-9493-c8edbcc359c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:49.880672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe0b63-77e5-4050-9493-c8edbcc359c5 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:49.880947 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe0b63-77e5-4050-9493-c8edbcc359c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:49.881229 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe0b63-77e5-4050-9493-c8edbcc359c5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:49.888530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe0b63-77e5-4050-9493-c8edbcc359c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:49.889493 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7567623-2cd5-4537-9d22-939f3c8d4c8f None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:49.890058 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe0b63-77e5-4050-9493-c8edbcc359c5 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:49.901274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-3dbe0b63-77e5-4050-9493-c8edbcc359c5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 19:12:49.901274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:49.901274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:49.901274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:49.901274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:49.901274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:49.901274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:49.901274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:49.901274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:49.901274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:49.901274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:49.901274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:49.901274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:12:49.901274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:12:49.901274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:12:49.901274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:12:49.902177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:49.902177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:49.902177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:12:49.902177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:12:49.902177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:12:49.902177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:12:49.902177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:49.902177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:49.902177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:49.902177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:49.902177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:49.902177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:49.902177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:49.902177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:49.902177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:49.902177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:49.902177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:49.902177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:49.903419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:49.903419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:49.903419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:12:49.903419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:12:49.903419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:12:49.903419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:12:49.903419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:12:49.903419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:12:49.903419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 19:12:49.903419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:49.903419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 247/502] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:49.903419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe0b63-77e5-4050-9493-c8edbcc359c5 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:49.916347 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:49.928710 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfce9a7-c46d-417b-ac3c-95eb8b865e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:49.929412 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfce9a7-c46d-417b-ac3c-95eb8b865e58 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:49.929756 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfce9a7-c46d-417b-ac3c-95eb8b865e58 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:49.930095 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfce9a7-c46d-417b-ac3c-95eb8b865e58 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:49.937670 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfce9a7-c46d-417b-ac3c-95eb8b865e58 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:49.939173 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfce9a7-c46d-417b-ac3c-95eb8b865e58 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:49.951776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-4cfce9a7-c46d-417b-ac3c-95eb8b865e58 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 19:12:49.951776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:49.951776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:49.951776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:49.951776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:49.951776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:49.951776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:49.951776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:49.951776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:49.951776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:49.951776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:49.951776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:49.951776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:12:49.951776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:12:49.951776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:12:49.951776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:12:49.952816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:49.952816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:49.952816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:12:49.952816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:12:49.952816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:12:49.952816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:12:49.952816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:49.952816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:49.952816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:49.952816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:49.952816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:49.952816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:49.952816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:49.952816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:49.952816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:49.952816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:49.952816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:49.952816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:49.953730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:49.953730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:49.953730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:12:49.953730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:12:49.953730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:12:49.953730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:12:49.953730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:12:49.953730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:12:49.953730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 19:12:49.953730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:49.953730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 256/503] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:49.954295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfce9a7-c46d-417b-ac3c-95eb8b865e58 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:50.006497 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe0b63-77e5-4050-9493-c8edbcc359c5 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:50.041211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbc7e8-c053-41ed-ae49-ad1ba533cd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:50.041859 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbc7e8-c053-41ed-ae49-ad1ba533cd1d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:50.042139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbc7e8-c053-41ed-ae49-ad1ba533cd1d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:50.042409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbc7e8-c053-41ed-ae49-ad1ba533cd1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:50.052847 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dbc7e8-c053-41ed-ae49-ad1ba533cd1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:50.053736 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfce9a7-c46d-417b-ac3c-95eb8b865e58 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:50.054309 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dbc7e8-c053-41ed-ae49-ad1ba533cd1d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:50.068587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-50dbc7e8-c053-41ed-ae49-ad1ba533cd1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:50.068587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:50.068587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:50.068587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:50.068587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:50.068587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:50.068587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:50.068587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:50.068587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:50.068587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:50.068587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:50.068587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:50.068587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:50.068587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:50.068587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:50.068587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:50.069511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:50.069511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:50.069511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:50.069511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:50.069511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:50.069511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:50.069511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:50.069511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:50.069511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:50.069511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:50.069511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:50.069511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:50.069511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:50.069511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:50.069511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:50.069511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:50.069511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:50.070336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:50.070336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:50.070336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:50.070336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 248/504] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:50.070581 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbc7e8-c053-41ed-ae49-ad1ba533cd1d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:50.084785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:50.093586 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b89b1-21c5-4a7b-90a9-a9274964c49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:50.095344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b89b1-21c5-4a7b-90a9-a9274964c49b None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:50.095344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b89b1-21c5-4a7b-90a9-a9274964c49b None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:50.095344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b89b1-21c5-4a7b-90a9-a9274964c49b None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:50.095579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b89b1-21c5-4a7b-90a9-a9274964c49b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:50.095878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b89b1-21c5-4a7b-90a9-a9274964c49b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:50.097257 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b89b1-21c5-4a7b-90a9-a9274964c49b None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:50.109303 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 257/505] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:50.110040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b89b1-21c5-4a7b-90a9-a9274964c49b None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:50.135414 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:50.173558 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbc7e8-c053-41ed-ae49-ad1ba533cd1d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:50.208358 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920efe49-7189-4f6f-b4c0-7a3beb014dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:50.208959 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920efe49-7189-4f6f-b4c0-7a3beb014dc7 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:50.209233 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920efe49-7189-4f6f-b4c0-7a3beb014dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:50.209324 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b89b1-21c5-4a7b-90a9-a9274964c49b None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:50.209499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920efe49-7189-4f6f-b4c0-7a3beb014dc7 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:50.210206 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920efe49-7189-4f6f-b4c0-7a3beb014dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:50.210504 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920efe49-7189-4f6f-b4c0-7a3beb014dc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:50.212534 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920efe49-7189-4f6f-b4c0-7a3beb014dc7 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:50.229347 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 249/506] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Aug 19 19:12:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:50.230160 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920efe49-7189-4f6f-b4c0-7a3beb014dc7 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:50.244496 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7099308-b364-49e4-bb9e-8e1a9ee8c6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:50.245098 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7099308-b364-49e4-bb9e-8e1a9ee8c6d5 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:50.245398 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7099308-b364-49e4-bb9e-8e1a9ee8c6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:50.245669 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7099308-b364-49e4-bb9e-8e1a9ee8c6d5 None admin] PATH_INFO: `/v3/users` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:50.246412 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7099308-b364-49e4-bb9e-8e1a9ee8c6d5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:50.246747 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7099308-b364-49e4-bb9e-8e1a9ee8c6d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:50.248204 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7099308-b364-49e4-bb9e-8e1a9ee8c6d5 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:50.284488 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 258/507] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Aug 19 19:12:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:50.285239 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7099308-b364-49e4-bb9e-8e1a9ee8c6d5 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:50.330889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:50.333589 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920efe49-7189-4f6f-b4c0-7a3beb014dc7 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:50.355325 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:50.370082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0bae9-918d-49af-8367-3b32ddcfe7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:50.370665 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0bae9-918d-49af-8367-3b32ddcfe7fe None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:50.370945 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0bae9-918d-49af-8367-3b32ddcfe7fe None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:50.371214 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0bae9-918d-49af-8367-3b32ddcfe7fe None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:50.371842 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0bae9-918d-49af-8367-3b32ddcfe7fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:50.372143 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0bae9-918d-49af-8367-3b32ddcfe7fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:50.373535 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0bae9-918d-49af-8367-3b32ddcfe7fe None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:50.384556 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 250/508] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:50.385318 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7099308-b364-49e4-bb9e-8e1a9ee8c6d5 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:50.385671 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0bae9-918d-49af-8367-3b32ddcfe7fe None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:50.423446 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72e1bf-87b8-4c16-969e-6e6f1c2f36de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:50.424039 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72e1bf-87b8-4c16-969e-6e6f1c2f36de None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:50.424315 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72e1bf-87b8-4c16-969e-6e6f1c2f36de None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:50.424588 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72e1bf-87b8-4c16-969e-6e6f1c2f36de None admin] PATH_INFO: `/v3/projects/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:50.435130 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72e1bf-87b8-4c16-969e-6e6f1c2f36de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:50.436575 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72e1bf-87b8-4c16-969e-6e6f1c2f36de None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:50.449541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-2f72e1bf-87b8-4c16-969e-6e6f1c2f36de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:12:50.449541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:50.449541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:50.449541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:50.449541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:50.449541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:50.449541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:50.449541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:50.449541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:50.449541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:50.449541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:50.449541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:50.449541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:12:50.449541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:12:50.449541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:12:50.450600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:12:50.450600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:50.450600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:50.450600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:50.450600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:50.450600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:50.450600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:50.450600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:50.450600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:50.450600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:50.450600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:50.450600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:50.450600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:50.450600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:50.450600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:50.450600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:50.450600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:50.456608 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:12:50.456608 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:12:50.456608 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:12:50.456608 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:12:50.456608 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:12:50.456608 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:12:50.456608 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:12:50.456608 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:50.456608 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 259/509] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:12:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:50.456608 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72e1bf-87b8-4c16-969e-6e6f1c2f36de None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:50.487180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0bae9-918d-49af-8367-3b32ddcfe7fe None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:50.520387 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b6bc6-cffb-4cac-896d-5eac19f74577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:50.521086 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b6bc6-cffb-4cac-896d-5eac19f74577 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:50.521430 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b6bc6-cffb-4cac-896d-5eac19f74577 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:50.521765 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b6bc6-cffb-4cac-896d-5eac19f74577 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:50.555324 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72e1bf-87b8-4c16-969e-6e6f1c2f36de None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:50.557579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:50.571034 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:50.591450 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b6bc6-cffb-4cac-896d-5eac19f74577 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:50.592299 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440f5b0-c296-4924-ad38-bf39c7e0fa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:50.592894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440f5b0-c296-4924-ad38-bf39c7e0fa78 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:50.592985 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b6bc6-cffb-4cac-896d-5eac19f74577 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:50.593175 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440f5b0-c296-4924-ad38-bf39c7e0fa78 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:50.593444 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440f5b0-c296-4924-ad38-bf39c7e0fa78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:50.662294 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440f5b0-c296-4924-ad38-bf39c7e0fa78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:50.663805 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440f5b0-c296-4924-ad38-bf39c7e0fa78 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:50.689589 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 251/510] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:50.690630 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b6bc6-cffb-4cac-896d-5eac19f74577 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:50.767212 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 260/511] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:50.768053 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440f5b0-c296-4924-ad38-bf39c7e0fa78 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:50.771078 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:50.773205 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:50.792679 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b6bc6-cffb-4cac-896d-5eac19f74577 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:50.835242 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f55807-9da9-4af0-8eb6-d38b2b3c3fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:50.835861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f55807-9da9-4af0-8eb6-d38b2b3c3fe1 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:50.836195 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f55807-9da9-4af0-8eb6-d38b2b3c3fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:50.836610 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f55807-9da9-4af0-8eb6-d38b2b3c3fe1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:50.843737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f55807-9da9-4af0-8eb6-d38b2b3c3fe1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:50.845162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f55807-9da9-4af0-8eb6-d38b2b3c3fe1 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:50.857499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-58f55807-9da9-4af0-8eb6-d38b2b3c3fe1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 19:12:50.857499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:50.857499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:50.857499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:50.857499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:50.857499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:50.857499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:50.857499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:50.857499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:50.857499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:50.857499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:50.857499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:50.857499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:12:50.857499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:12:50.857499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:12:50.857499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:12:50.858647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:50.858647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:50.858647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:12:50.858647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:12:50.858647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:12:50.858647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:12:50.858647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:50.858647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:50.858647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:50.858647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:50.858647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:50.858647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:50.858647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:50.858647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:50.858647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:50.858647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:50.858647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:50.858647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:50.859624 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:50.859624 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:50.859624 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:12:50.859624 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:12:50.859624 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:12:50.859624 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:12:50.859624 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:12:50.859624 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:12:50.859624 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 19:12:50.859624 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:50.859624 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 252/512] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Aug 19 19:12:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:50.859624 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f55807-9da9-4af0-8eb6-d38b2b3c3fe1 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:50.870500 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440f5b0-c296-4924-ad38-bf39c7e0fa78 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:50.906605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944380c-d39d-4e82-85a6-0f7d9a8e99f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:50.907203 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944380c-d39d-4e82-85a6-0f7d9a8e99f0 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:50.907481 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944380c-d39d-4e82-85a6-0f7d9a8e99f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:50.907752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944380c-d39d-4e82-85a6-0f7d9a8e99f0 None admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:50.908431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944380c-d39d-4e82-85a6-0f7d9a8e99f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:50.908733 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944380c-d39d-4e82-85a6-0f7d9a8e99f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:50.910204 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944380c-d39d-4e82-85a6-0f7d9a8e99f0 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:50.928838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 261/513] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:50.929580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944380c-d39d-4e82-85a6-0f7d9a8e99f0 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:50.967010 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f55807-9da9-4af0-8eb6-d38b2b3c3fe1 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:50.991676 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:51.000643 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b176e9b-bc49-4066-8c5a-a4af6168ccc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:51.001276 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b176e9b-bc49-4066-8c5a-a4af6168ccc7 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:51.001549 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b176e9b-bc49-4066-8c5a-a4af6168ccc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:51.001820 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b176e9b-bc49-4066-8c5a-a4af6168ccc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:51.011035 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:51.013125 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b176e9b-bc49-4066-8c5a-a4af6168ccc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:51.014624 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b176e9b-bc49-4066-8c5a-a4af6168ccc7 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:51.028926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-5b176e9b-bc49-4066-8c5a-a4af6168ccc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:51.028926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:51.028926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:51.028926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:51.028926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:51.028926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:51.028926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:51.028926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:51.028926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:51.028926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:51.028926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:51.028926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:51.028926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:51.028926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:51.028926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:51.028926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:51.032134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:51.032134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:51.032134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:51.032134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:51.032134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:51.032134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:51.032134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:51.032134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:51.032134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:51.032134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:51.032134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:51.032134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:51.032134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:51.032134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:51.032134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:51.032134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:51.032134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:51.033165 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:51.033165 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:51.033165 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:51.033165 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 253/514] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:51.033165 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b176e9b-bc49-4066-8c5a-a4af6168ccc7 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:51.041557 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944380c-d39d-4e82-85a6-0f7d9a8e99f0 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:51.076008 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa93529-924e-4680-8e3b-3876e14ca5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:51.076628 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa93529-924e-4680-8e3b-3876e14ca5b8 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:51.076905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa93529-924e-4680-8e3b-3876e14ca5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:51.077173 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa93529-924e-4680-8e3b-3876e14ca5b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:51.086936 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa93529-924e-4680-8e3b-3876e14ca5b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:51.088376 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa93529-924e-4680-8e3b-3876e14ca5b8 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:51.102967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-5aa93529-924e-4680-8e3b-3876e14ca5b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:51.102967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:51.102967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:51.102967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:51.102967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:51.102967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:51.102967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:51.102967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:51.102967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:51.102967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:51.102967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:51.102967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:51.102967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:51.102967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:51.102967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:51.102967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:51.103860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:51.103860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:51.103860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:51.103860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:51.103860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:51.103860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:51.103860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:51.103860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:51.103860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:51.103860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:51.103860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:51.103860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:51.103860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:51.103860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:51.103860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:51.103860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:51.103860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:51.104697 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:51.104697 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:51.104697 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:51.108649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 262/515] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:51.109343 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa93529-924e-4680-8e3b-3876e14ca5b8 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:51.133371 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b176e9b-bc49-4066-8c5a-a4af6168ccc7 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:51.168443 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc7dee-3563-4660-b5e4-9ff19ffee8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:51.169048 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc7dee-3563-4660-b5e4-9ff19ffee8d2 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:51.169321 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc7dee-3563-4660-b5e4-9ff19ffee8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:51.169597 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc7dee-3563-4660-b5e4-9ff19ffee8d2 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:51.170310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc7dee-3563-4660-b5e4-9ff19ffee8d2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:51.170641 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc7dee-3563-4660-b5e4-9ff19ffee8d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:51.172079 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc7dee-3563-4660-b5e4-9ff19ffee8d2 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:51.193797 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 254/516] 10.222.0.61 () {56 vars in 1139 bytes} [Fri Aug 19 19:12:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:51.193797 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc7dee-3563-4660-b5e4-9ff19ffee8d2 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:51.214974 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa93529-924e-4680-8e3b-3876e14ca5b8 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:51.231454 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:51.244557 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:51.253216 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c2b1d-42ec-4beb-9fb4-eb4d67ac9fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:51.253813 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c2b1d-42ec-4beb-9fb4-eb4d67ac9fcb None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:51.254099 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c2b1d-42ec-4beb-9fb4-eb4d67ac9fcb None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:51.254364 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c2b1d-42ec-4beb-9fb4-eb4d67ac9fcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:51.255693 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c2b1d-42ec-4beb-9fb4-eb4d67ac9fcb None admin] RBAC: Adding query filter params (role.id=1201f07f50a74488936b4eba2ba9a82c, scope.project.id=409a043500554125a93c4636db5a6812, user.id=54c899e786614c18b2bf4334ceb2f891) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:51.255693 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c2b1d-42ec-4beb-9fb4-eb4d67ac9fcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:51.256971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c2b1d-42ec-4beb-9fb4-eb4d67ac9fcb None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:51.264282 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 263/517] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:12:51 2022] GET /identity/v3/role_assignments?user.id=54c899e786614c18b2bf4334ceb2f891&scope.project.id=409a043500554125a93c4636db5a6812&role.id=1201f07f50a74488936b4eba2ba9a82c => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:51.265072 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c2b1d-42ec-4beb-9fb4-eb4d67ac9fcb None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:51.299558 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc7dee-3563-4660-b5e4-9ff19ffee8d2 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:51.342075 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee5b0c-d6a0-49cd-87a3-d440d0f8d5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:51.342724 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee5b0c-d6a0-49cd-87a3-d440d0f8d5b5 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:51.342998 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee5b0c-d6a0-49cd-87a3-d440d0f8d5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:51.343265 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee5b0c-d6a0-49cd-87a3-d440d0f8d5b5 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:51.343919 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee5b0c-d6a0-49cd-87a3-d440d0f8d5b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:51.344230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee5b0c-d6a0-49cd-87a3-d440d0f8d5b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:51.345650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee5b0c-d6a0-49cd-87a3-d440d0f8d5b5 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:51.358305 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 255/518] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:51.359212 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee5b0c-d6a0-49cd-87a3-d440d0f8d5b5 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:51.384757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c2b1d-42ec-4beb-9fb4-eb4d67ac9fcb None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:51.424235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73dedb-4415-41ed-9398-37539727c59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:51.424882 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73dedb-4415-41ed-9398-37539727c59f None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:51.425225 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73dedb-4415-41ed-9398-37539727c59f None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:51.425412 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73dedb-4415-41ed-9398-37539727c59f None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:51.426121 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73dedb-4415-41ed-9398-37539727c59f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:51.426332 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73dedb-4415-41ed-9398-37539727c59f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:51.427820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73dedb-4415-41ed-9398-37539727c59f None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:51.444223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 264/519] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:51.445000 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73dedb-4415-41ed-9398-37539727c59f None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:51.475884 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee5b0c-d6a0-49cd-87a3-d440d0f8d5b5 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:51.487858 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:51.493038 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:51.513240 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f7163-d982-4398-97ca-c53fad07b429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:51.513844 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f7163-d982-4398-97ca-c53fad07b429 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:51.514122 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f7163-d982-4398-97ca-c53fad07b429 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:51.514391 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f7163-d982-4398-97ca-c53fad07b429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:51.553737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73dedb-4415-41ed-9398-37539727c59f None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:51.594064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda7ffb-adb0-4bb6-bd16-079784e7bb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:51.594716 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda7ffb-adb0-4bb6-bd16-079784e7bb56 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:51.595101 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda7ffb-adb0-4bb6-bd16-079784e7bb56 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:51.595261 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda7ffb-adb0-4bb6-bd16-079784e7bb56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:51.599209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f7163-d982-4398-97ca-c53fad07b429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:51.600856 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f7163-d982-4398-97ca-c53fad07b429 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:51.602594 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda7ffb-adb0-4bb6-bd16-079784e7bb56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:51.604303 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda7ffb-adb0-4bb6-bd16-079784e7bb56 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:51.616665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-6cda7ffb-adb0-4bb6-bd16-079784e7bb56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:12:51.616665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:51.616665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:51.616665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:51.616665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:51.616665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:51.616665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:51.616665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:51.616665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:51.616665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:51.616665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:51.616665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:51.616665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:12:51.616665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:12:51.616665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:12:51.617593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:12:51.617593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:51.617593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:51.617593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:51.617593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:51.617593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:51.617593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:51.617593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:51.617593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:51.617593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:51.617593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:51.617593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:51.617593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:51.617593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:51.617593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:51.617593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:51.617593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:51.619162 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:12:51.619162 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:12:51.619162 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:12:51.619162 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:12:51.619162 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:12:51.619162 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:12:51.619162 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:12:51.619162 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:51.619162 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 265/520] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:12:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:51.619648 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda7ffb-adb0-4bb6-bd16-079784e7bb56 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:51.715322 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:51.718307 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda7ffb-adb0-4bb6-bd16-079784e7bb56 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:51.723948 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 256/521] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:12:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:12:51.725040 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f7163-d982-4398-97ca-c53fad07b429 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:51.738094 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:51.753796 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016f214-cbd5-466e-8c5d-cc37484ca203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:51.754543 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016f214-cbd5-466e-8c5d-cc37484ca203 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:51.754821 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016f214-cbd5-466e-8c5d-cc37484ca203 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:51.755091 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016f214-cbd5-466e-8c5d-cc37484ca203 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:51.762699 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016f214-cbd5-466e-8c5d-cc37484ca203 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:51.764152 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016f214-cbd5-466e-8c5d-cc37484ca203 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:51.775453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-c016f214-cbd5-466e-8c5d-cc37484ca203 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:12:51.775453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:51.775453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:51.775453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:51.775453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:51.775453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:51.775453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:51.775453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:51.775453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:51.775453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:51.775453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:51.775453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:51.775453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:12:51.775453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:12:51.775453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:12:51.776313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:12:51.776313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:51.776313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:51.776313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:51.776313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:51.776313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:51.776313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:51.776313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:51.776313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:51.776313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:51.776313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:51.776313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:51.776313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:51.776313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:51.776313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:51.776313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:51.776313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:51.777236 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:12:51.777236 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:12:51.777236 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:12:51.777236 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:12:51.777236 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:12:51.777236 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:12:51.777236 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:12:51.777236 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:51.777236 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 266/522] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:12:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:51.777703 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016f214-cbd5-466e-8c5d-cc37484ca203 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:51.837876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f7163-d982-4398-97ca-c53fad07b429 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:51.874324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b58bc5-dd83-4fa0-a651-7a3aba8ed967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:51.874960 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b58bc5-dd83-4fa0-a651-7a3aba8ed967 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:51.875225 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b58bc5-dd83-4fa0-a651-7a3aba8ed967 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:51.875490 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b58bc5-dd83-4fa0-a651-7a3aba8ed967 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:51.876170 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b58bc5-dd83-4fa0-a651-7a3aba8ed967 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:51.876470 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b58bc5-dd83-4fa0-a651-7a3aba8ed967 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:51.877891 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b58bc5-dd83-4fa0-a651-7a3aba8ed967 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:51.887069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016f214-cbd5-466e-8c5d-cc37484ca203 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:51.896127 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 257/523] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:12:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:51.897005 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b58bc5-dd83-4fa0-a651-7a3aba8ed967 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:51.927534 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42648ad0-ba10-42af-b38c-7b901f5cab56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:51.928159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42648ad0-ba10-42af-b38c-7b901f5cab56 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:51.928434 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42648ad0-ba10-42af-b38c-7b901f5cab56 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:51.928705 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42648ad0-ba10-42af-b38c-7b901f5cab56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:51.940877 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42648ad0-ba10-42af-b38c-7b901f5cab56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:51.942952 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42648ad0-ba10-42af-b38c-7b901f5cab56 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:51.961991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-42648ad0-ba10-42af-b38c-7b901f5cab56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:51.961991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:51.961991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:51.961991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:51.961991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:51.961991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:51.961991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:51.961991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:51.961991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:51.961991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:51.961991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:51.961991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:51.961991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:51.961991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:51.961991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:51.961991 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:51.963122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:51.963122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:51.963122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:51.963122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:51.963122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:51.963122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:51.963122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:51.963122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:51.963122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:51.963122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:51.963122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:51.963122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:51.963122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:51.963122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:51.963122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:51.963122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:51.963122 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:51.964008 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:51.964008 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:51.964008 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:51.964008 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 267/524] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:51.964773 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42648ad0-ba10-42af-b38c-7b901f5cab56 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:51.978554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:51.980292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:52.010650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b58bc5-dd83-4fa0-a651-7a3aba8ed967 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:52.044879 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bf17b-4985-4ea4-9d66-2670655da046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:52.045641 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bf17b-4985-4ea4-9d66-2670655da046 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:52.045926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bf17b-4985-4ea4-9d66-2670655da046 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:52.046199 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bf17b-4985-4ea4-9d66-2670655da046 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:52.046915 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bf17b-4985-4ea4-9d66-2670655da046 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:52.047218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bf17b-4985-4ea4-9d66-2670655da046 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:52.048719 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bf17b-4985-4ea4-9d66-2670655da046 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:52.060722 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 258/525] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:12:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:52.063542 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bf17b-4985-4ea4-9d66-2670655da046 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:52.071838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42648ad0-ba10-42af-b38c-7b901f5cab56 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:52.106721 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784b2d7-18eb-43f8-99da-1a61b3f7dc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:52.107315 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784b2d7-18eb-43f8-99da-1a61b3f7dc2a None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:52.107590 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784b2d7-18eb-43f8-99da-1a61b3f7dc2a None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:52.107865 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784b2d7-18eb-43f8-99da-1a61b3f7dc2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:52.108578 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784b2d7-18eb-43f8-99da-1a61b3f7dc2a None admin] RBAC: Adding query filter params (role.id=1201f07f50a74488936b4eba2ba9a82c, scope.project.id=409a043500554125a93c4636db5a6812, user.id=1bca70a332304359bcc9d873ebbe14de) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:52.108882 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784b2d7-18eb-43f8-99da-1a61b3f7dc2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:52.110313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784b2d7-18eb-43f8-99da-1a61b3f7dc2a None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:52.115727 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 268/526] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:12:51 2022] GET /identity/v3/role_assignments?user.id=1bca70a332304359bcc9d873ebbe14de&scope.project.id=409a043500554125a93c4636db5a6812&role.id=1201f07f50a74488936b4eba2ba9a82c => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:52.116504 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784b2d7-18eb-43f8-99da-1a61b3f7dc2a None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:52.192056 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bf17b-4985-4ea4-9d66-2670655da046 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:52.225344 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:52.232520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:52.233447 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4297b-0543-4679-a331-ed1b790293f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:52.234492 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4297b-0543-4679-a331-ed1b790293f6 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:52.234942 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4297b-0543-4679-a331-ed1b790293f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:52.235366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4297b-0543-4679-a331-ed1b790293f6 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:52.236224 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4297b-0543-4679-a331-ed1b790293f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:52.236667 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4297b-0543-4679-a331-ed1b790293f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:52.238294 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4297b-0543-4679-a331-ed1b790293f6 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:52.253241 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 259/527] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:52.261723 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4297b-0543-4679-a331-ed1b790293f6 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:52.268480 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784b2d7-18eb-43f8-99da-1a61b3f7dc2a None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:52.318031 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e01eea-dd2a-4dca-b3ec-0c92560d67bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:52.318743 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e01eea-dd2a-4dca-b3ec-0c92560d67bb None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:52.319023 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e01eea-dd2a-4dca-b3ec-0c92560d67bb None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:52.319291 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e01eea-dd2a-4dca-b3ec-0c92560d67bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:52.320021 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e01eea-dd2a-4dca-b3ec-0c92560d67bb None admin] RBAC: Adding query filter params (role.id=1201f07f50a74488936b4eba2ba9a82c, scope.project.id=409a043500554125a93c4636db5a6812, user.id=23bbd8bfe6924ea2a6fd35513f830cb4) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:52.320328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e01eea-dd2a-4dca-b3ec-0c92560d67bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:52.321870 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e01eea-dd2a-4dca-b3ec-0c92560d67bb None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:52.328276 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 269/528] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:12:52 2022] GET /identity/v3/role_assignments?user.id=23bbd8bfe6924ea2a6fd35513f830cb4&scope.project.id=409a043500554125a93c4636db5a6812&role.id=1201f07f50a74488936b4eba2ba9a82c => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:52.381950 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4297b-0543-4679-a331-ed1b790293f6 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:52.427045 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6f507-b137-4786-b9eb-bd64a3af8670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:52.427689 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6f507-b137-4786-b9eb-bd64a3af8670 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:52.427964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6f507-b137-4786-b9eb-bd64a3af8670 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:52.428238 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6f507-b137-4786-b9eb-bd64a3af8670 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:52.436741 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6f507-b137-4786-b9eb-bd64a3af8670 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:52.438227 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6f507-b137-4786-b9eb-bd64a3af8670 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:52.452109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-d2e6f507-b137-4786-b9eb-bd64a3af8670 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:12:52.452109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:52.452109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:52.452109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:52.452109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:52.452109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:52.452109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:52.452109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:52.452109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:52.452109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:52.452109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:52.452109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:52.452109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:12:52.452109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:12:52.452109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:12:52.453106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:12:52.453106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:52.453106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:52.453106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:52.453106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:52.453106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:52.453106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:52.453106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:52.453106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:52.453106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:52.453106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:52.453106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:52.453106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:52.453106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:52.453106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:52.453106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:52.453106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:52.453955 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:12:52.453955 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:12:52.453955 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:12:52.453955 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:12:52.453955 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:12:52.453955 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:12:52.453955 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:12:52.453955 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:52.458216 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 260/529] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:12:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:52.459641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e01eea-dd2a-4dca-b3ec-0c92560d67bb None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:52.574062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e01eea-dd2a-4dca-b3ec-0c92560d67bb None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:52.610354 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91838ea-ae3d-439d-8f35-77966adc37c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:52.610998 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91838ea-ae3d-439d-8f35-77966adc37c2 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:52.611264 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91838ea-ae3d-439d-8f35-77966adc37c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:52.611540 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91838ea-ae3d-439d-8f35-77966adc37c2 None admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:52.612228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91838ea-ae3d-439d-8f35-77966adc37c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:52.612532 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91838ea-ae3d-439d-8f35-77966adc37c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:52.613957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91838ea-ae3d-439d-8f35-77966adc37c2 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:52.623992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:52.630726 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 270/530] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:12:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:52.633118 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6f507-b137-4786-b9eb-bd64a3af8670 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:52.688513 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:52.743696 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6f507-b137-4786-b9eb-bd64a3af8670 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:52.779699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62264af3-e576-4d0f-8678-b057493ebd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:52.780307 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62264af3-e576-4d0f-8678-b057493ebd07 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:52.780585 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62264af3-e576-4d0f-8678-b057493ebd07 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:52.780857 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62264af3-e576-4d0f-8678-b057493ebd07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:52.781574 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62264af3-e576-4d0f-8678-b057493ebd07 None admin] RBAC: Adding query filter params (role.id=1201f07f50a74488936b4eba2ba9a82c, scope.project.id=409a043500554125a93c4636db5a6812, user.id=84bd0bde9a164516a26768a3eb44fdec) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:52.781885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62264af3-e576-4d0f-8678-b057493ebd07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:52.783390 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62264af3-e576-4d0f-8678-b057493ebd07 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:52.788939 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 261/531] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:12:52 2022] GET /identity/v3/role_assignments?user.id=84bd0bde9a164516a26768a3eb44fdec&scope.project.id=409a043500554125a93c4636db5a6812&role.id=1201f07f50a74488936b4eba2ba9a82c => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:53.536805 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709873b-9952-4df8-b19f-f3b749a7e88c None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:53.537316 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709873b-9952-4df8-b19f-f3b749a7e88c None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:53.537316 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709873b-9952-4df8-b19f-f3b749a7e88c None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:53.539102 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 271/532] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:53.544612 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123eeaf-7b92-4189-a484-ac34551d80a7 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:53.544907 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123eeaf-7b92-4189-a484-ac34551d80a7 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:53.545186 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123eeaf-7b92-4189-a484-ac34551d80a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:53.564388 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-0123eeaf-7b92-4189-a484-ac34551d80a7 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:53.565583 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-0123eeaf-7b92-4189-a484-ac34551d80a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:53.642306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 262/533] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:53.969075 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709873b-9952-4df8-b19f-f3b749a7e88c None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:54.078783 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709873b-9952-4df8-b19f-f3b749a7e88c None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:54.113596 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ff77e-a907-40e0-87cb-e8216e856d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:54.114223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ff77e-a907-40e0-87cb-e8216e856d62 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:54.114500 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ff77e-a907-40e0-87cb-e8216e856d62 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:54.114794 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ff77e-a907-40e0-87cb-e8216e856d62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:54.126037 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ff77e-a907-40e0-87cb-e8216e856d62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:54.130668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-ed0ff77e-a907-40e0-87cb-e8216e856d62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:12:54.130668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:54.130668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:54.130668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:54.130668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:54.130668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:54.130668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:54.130668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:54.130668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:54.130668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:54.130668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:54.130668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:54.130668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:54.130668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:54.130668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:54.130668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:54.131605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:54.131605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:54.131605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:54.131605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:54.131605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:54.131605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:54.131605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:54.131605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:54.131605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:54.131605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:54.131605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:54.131605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:54.131605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:54.131605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:54.131605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:54.131605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:54.132850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:54.132850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:54.132850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:54.132850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:54.132850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:54.132850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:54.132850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:54.132850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:54.132850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:54.132850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:54.132850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:12:54.132850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:54.132850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 272/534] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Aug 19 19:12:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:54.138084 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123eeaf-7b92-4189-a484-ac34551d80a7 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:54.194950 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:54.244737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123eeaf-7b92-4189-a484-ac34551d80a7 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:54.285925 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ba5b3-21d9-4a40-a3f1-4b727d27ccbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:54.286569 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ba5b3-21d9-4a40-a3f1-4b727d27ccbe None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:54.286845 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ba5b3-21d9-4a40-a3f1-4b727d27ccbe None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:54.287117 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ba5b3-21d9-4a40-a3f1-4b727d27ccbe None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:54.287788 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ba5b3-21d9-4a40-a3f1-4b727d27ccbe None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:54.288093 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ba5b3-21d9-4a40-a3f1-4b727d27ccbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:54.289538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ba5b3-21d9-4a40-a3f1-4b727d27ccbe None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:54.298623 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 263/535] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Aug 19 19:12:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:54.304157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ff77e-a907-40e0-87cb-e8216e856d62 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:54.368867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:54.410552 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ff77e-a907-40e0-87cb-e8216e856d62 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:54.418920 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3db3cb-8fa0-43f3-9a0c-0ce911a83f92 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:54.419195 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3db3cb-8fa0-43f3-9a0c-0ce911a83f92 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:54.419474 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3db3cb-8fa0-43f3-9a0c-0ce911a83f92 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:54.421736 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 264/536] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:54.427391 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2a197-1c60-4037-9b3c-f4927bcd8a88 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:54.427784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2a197-1c60-4037-9b3c-f4927bcd8a88 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:54.428533 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2a197-1c60-4037-9b3c-f4927bcd8a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:54.449556 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78461071-0835-4906-98b6-839a113ecbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:54.450416 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78461071-0835-4906-98b6-839a113ecbbd None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:54.450879 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78461071-0835-4906-98b6-839a113ecbbd None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:54.451303 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78461071-0835-4906-98b6-839a113ecbbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:54.453675 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-37f2a197-1c60-4037-9b3c-f4927bcd8a88 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:54.455984 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-37f2a197-1c60-4037-9b3c-f4927bcd8a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:54.463644 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78461071-0835-4906-98b6-839a113ecbbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:54.467586 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78461071-0835-4906-98b6-839a113ecbbd None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:54.488989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-78461071-0835-4906-98b6-839a113ecbbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:54.488989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:54.488989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:54.488989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:54.488989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:54.488989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:54.488989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:54.488989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:54.488989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:54.488989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:54.488989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:54.488989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:54.488989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:54.488989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:54.488989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:54.488989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:54.489941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:54.489941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:54.489941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:54.489941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:54.489941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:54.489941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:54.489941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:54.489941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:54.489941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:54.489941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:54.489941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:54.489941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:54.489941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:54.489941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:54.489941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:54.489941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:54.489941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:54.490836 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:54.490836 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:54.490836 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:54.494692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 273/537] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:54.498479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78461071-0835-4906-98b6-839a113ecbbd None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:54.550547 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 265/538] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 19 19:12:54.625383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78461071-0835-4906-98b6-839a113ecbbd None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:54.639488 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:54.661542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cda404-d3e2-49d7-84b7-975235eff087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:54.662177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cda404-d3e2-49d7-84b7-975235eff087 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:54.662451 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cda404-d3e2-49d7-84b7-975235eff087 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:54.662750 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cda404-d3e2-49d7-84b7-975235eff087 None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:54.663475 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cda404-d3e2-49d7-84b7-975235eff087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:54.663781 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cda404-d3e2-49d7-84b7-975235eff087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:54.665329 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cda404-d3e2-49d7-84b7-975235eff087 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:54.677989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 274/539] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:54.680364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23275d-4af5-4d1f-a755-630dba14f79f None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:54.680815 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23275d-4af5-4d1f-a755-630dba14f79f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:54.680909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23275d-4af5-4d1f-a755-630dba14f79f None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:54.682325 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 266/540] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:54.683785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cda404-d3e2-49d7-84b7-975235eff087 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:54.687735 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90802de-d832-4772-858d-31b7fa12079f None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:54.688012 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90802de-d832-4772-858d-31b7fa12079f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:54.688894 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90802de-d832-4772-858d-31b7fa12079f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:54.712336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-e90802de-d832-4772-858d-31b7fa12079f None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:54.714241 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e90802de-d832-4772-858d-31b7fa12079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:54.748985 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:54.794942 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 267/541] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:12:54.815305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cda404-d3e2-49d7-84b7-975235eff087 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:54.854038 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ba206-ea0d-4690-b87f-a59fb552bd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:54.855115 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ba206-ea0d-4690-b87f-a59fb552bd29 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:54.855628 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ba206-ea0d-4690-b87f-a59fb552bd29 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:54.860181 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ba206-ea0d-4690-b87f-a59fb552bd29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:54.864828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ba206-ea0d-4690-b87f-a59fb552bd29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:54.866470 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ba206-ea0d-4690-b87f-a59fb552bd29 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:54.879298 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-2a3ba206-ea0d-4690-b87f-a59fb552bd29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:12:54.879298 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:54.879298 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:54.879298 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:54.879298 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:54.879298 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:54.879298 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:54.879298 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:54.879298 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:54.879298 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:54.879298 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:54.879298 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:54.879298 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:12:54.879298 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:12:54.879298 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:12:54.879298 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:12:54.880256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:54.880256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:54.880256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:12:54.880256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:12:54.880256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:12:54.880256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:12:54.880256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:54.880256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:54.880256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:54.880256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:54.880256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:54.880256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:54.880256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:54.880256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:54.880256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:54.880256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:54.880256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:54.880256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:54.881184 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:54.881184 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:54.881184 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:12:54.881184 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:12:54.881184 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:12:54.881184 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:12:54.881184 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:12:54.881184 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:12:54.881184 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:12:54.881184 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:54.884346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 275/542] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Aug 19 19:12:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:54.891723 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90802de-d832-4772-858d-31b7fa12079f None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:54.898925 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ba206-ea0d-4690-b87f-a59fb552bd29 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:54.937307 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:55.013115 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ba206-ea0d-4690-b87f-a59fb552bd29 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:55.036732 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90802de-d832-4772-858d-31b7fa12079f None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:55.049116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5aaa3b-2f37-40c3-a96f-07eae7a2455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:55.049974 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aaa3b-2f37-40c3-a96f-07eae7a2455f None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:55.050107 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aaa3b-2f37-40c3-a96f-07eae7a2455f None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:55.050346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aaa3b-2f37-40c3-a96f-07eae7a2455f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:55.066175 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5aaa3b-2f37-40c3-a96f-07eae7a2455f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:55.072242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-0e5aaa3b-2f37-40c3-a96f-07eae7a2455f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:12:55.072242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:55.072242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:55.072242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:55.072242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:55.072242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:55.072242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:55.072242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:55.072242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:55.072242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:55.072242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:55.072242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:55.072242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:55.072242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:55.072242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:55.072242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:55.073218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:55.073218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:55.073218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:55.073218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:55.073218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:55.073218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:55.073218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:55.073218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:55.073218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:55.073218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:55.073218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:55.073218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:55.073218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:55.073218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:55.073218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:55.073218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:55.074005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:55.074005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:55.074005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:55.074005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:55.074005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:55.074005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:55.074005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:55.074005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:55.074005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:55.074005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:55.074005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:12:55.074005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:55.074005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 276/543] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Aug 19 19:12:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:12:55.075539 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856185b3-3a10-4c98-9eac-e76f387070ff None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:55.075539 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856185b3-3a10-4c98-9eac-e76f387070ff None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:55.075539 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856185b3-3a10-4c98-9eac-e76f387070ff None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:55.077012 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 277/544] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:12:55.081548 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856185b3-3a10-4c98-9eac-e76f387070ff None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:55.086272 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820e390-86d3-4b10-8adb-0478a176554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:55.086909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820e390-86d3-4b10-8adb-0478a176554c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:55.087109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820e390-86d3-4b10-8adb-0478a176554c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:55.087366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820e390-86d3-4b10-8adb-0478a176554c None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:55.088087 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820e390-86d3-4b10-8adb-0478a176554c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:55.088387 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820e390-86d3-4b10-8adb-0478a176554c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:55.089804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820e390-86d3-4b10-8adb-0478a176554c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:55.113667 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 268/545] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Aug 19 19:12:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:55.113667 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e369b-c9e2-4d22-9d01-0c4986272b95 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:55.113667 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e369b-c9e2-4d22-9d01-0c4986272b95 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:55.113667 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e369b-c9e2-4d22-9d01-0c4986272b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:55.134553 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-8b2e369b-c9e2-4d22-9d01-0c4986272b95 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:55.135746 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8b2e369b-c9e2-4d22-9d01-0c4986272b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:55.155715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:55.175712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:55.190010 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856185b3-3a10-4c98-9eac-e76f387070ff None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:55.208431 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 269/546] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:55.209285 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e369b-c9e2-4d22-9d01-0c4986272b95 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:55.231233 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a771328-3e1f-4426-a011-34ee0d43640f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:55.231836 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a771328-3e1f-4426-a011-34ee0d43640f None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:55.232120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a771328-3e1f-4426-a011-34ee0d43640f None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:55.232389 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a771328-3e1f-4426-a011-34ee0d43640f None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:55.233051 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a771328-3e1f-4426-a011-34ee0d43640f None admin] RBAC: Adding query filter params (name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:55.233345 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a771328-3e1f-4426-a011-34ee0d43640f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:55.234729 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a771328-3e1f-4426-a011-34ee0d43640f None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:55.244309 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 278/547] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Aug 19 19:12:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:55.245114 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a771328-3e1f-4426-a011-34ee0d43640f None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:55.320010 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e369b-c9e2-4d22-9d01-0c4986272b95 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:55.353814 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe0722-91e5-4b79-9d6a-9be7a2b671ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:55.354453 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe0722-91e5-4b79-9d6a-9be7a2b671ac None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:55.354765 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe0722-91e5-4b79-9d6a-9be7a2b671ac None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:55.355046 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe0722-91e5-4b79-9d6a-9be7a2b671ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:55.359062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a771328-3e1f-4426-a011-34ee0d43640f None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:55.365467 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe0722-91e5-4b79-9d6a-9be7a2b671ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:55.366985 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe0722-91e5-4b79-9d6a-9be7a2b671ac None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:55.381876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-4cbe0722-91e5-4b79-9d6a-9be7a2b671ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:55.381876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:55.381876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:55.381876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:55.381876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:55.381876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:55.381876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:55.381876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:55.381876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:55.381876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:55.381876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:55.381876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:55.381876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:55.381876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:55.381876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:55.381876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:55.383338 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:55.383338 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:55.383338 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:55.383338 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:55.383338 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:55.383338 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:55.383338 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:55.383338 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:55.383338 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:55.383338 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:55.383338 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:55.383338 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:55.383338 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:55.383338 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:55.383338 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:55.383338 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:55.383338 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:55.384216 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:55.384216 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:55.384216 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:55.384216 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 270/548] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:55.384431 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe0722-91e5-4b79-9d6a-9be7a2b671ac None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:55.394920 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:55.400859 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9320fb-e0f2-4114-88e9-deca60d022a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:55.401485 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9320fb-e0f2-4114-88e9-deca60d022a1 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:55.401764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9320fb-e0f2-4114-88e9-deca60d022a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:55.402249 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9320fb-e0f2-4114-88e9-deca60d022a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:55.412522 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9320fb-e0f2-4114-88e9-deca60d022a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:55.418506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-8d9320fb-e0f2-4114-88e9-deca60d022a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:12:55.418506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:55.418506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:55.418506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:55.418506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:55.418506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:55.418506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:55.418506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:55.418506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:55.418506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:55.418506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:55.418506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:55.418506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:55.418506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:55.418506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:55.418506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:55.419399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:55.419399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:55.419399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:55.419399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:55.419399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:55.419399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:55.419399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:55.419399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:55.419399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:55.419399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:55.419399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:55.419399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:55.419399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:55.419399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:55.419399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:55.419399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:55.420186 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:55.420186 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:55.420186 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:55.420186 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:55.420186 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:55.420186 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:55.420186 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:55.420186 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:55.420186 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:55.420186 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:55.420186 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:12:55.420186 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:55.420186 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 279/549] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Aug 19 19:12:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:55.420839 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9320fb-e0f2-4114-88e9-deca60d022a1 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:55.436758 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:55.495938 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe0722-91e5-4b79-9d6a-9be7a2b671ac None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:55.529800 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9320fb-e0f2-4114-88e9-deca60d022a1 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:55.533698 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7150605-1834-47ea-9f61-bfe0cd95e771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:55.534344 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7150605-1834-47ea-9f61-bfe0cd95e771 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:55.534651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7150605-1834-47ea-9f61-bfe0cd95e771 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:55.534927 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7150605-1834-47ea-9f61-bfe0cd95e771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:55.547783 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7150605-1834-47ea-9f61-bfe0cd95e771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:55.549223 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7150605-1834-47ea-9f61-bfe0cd95e771 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:55.564098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-d7150605-1834-47ea-9f61-bfe0cd95e771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:55.564098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:55.564098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:55.564098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:55.564098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:55.564098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:55.564098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:55.564098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:55.564098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:55.564098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:55.564098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:55.564098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:55.564098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:55.564098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:55.564098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:55.564098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:55.570267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:55.570267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:55.570267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:55.570267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:55.570267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:55.570267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:55.570267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:55.570267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:55.570267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:55.570267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:55.570267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:55.570267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:55.570267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:55.570267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:55.570267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:55.570267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:55.570267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:55.571757 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:55.571757 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:55.571757 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:55.571757 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 271/550] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:55.571757 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7150605-1834-47ea-9f61-bfe0cd95e771 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:55.572200 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5adff-b813-4f28-9847-dbafc48d2477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:55.572200 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5adff-b813-4f28-9847-dbafc48d2477 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:55.572200 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5adff-b813-4f28-9847-dbafc48d2477 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:55.572200 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5adff-b813-4f28-9847-dbafc48d2477 None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:55.572486 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5adff-b813-4f28-9847-dbafc48d2477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:55.572486 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5adff-b813-4f28-9847-dbafc48d2477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:55.572486 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5adff-b813-4f28-9847-dbafc48d2477 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:55.583909 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 280/551] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:55.584938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5adff-b813-4f28-9847-dbafc48d2477 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:55.634219 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:55.669014 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:55.679301 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7150605-1834-47ea-9f61-bfe0cd95e771 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:55.694928 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5adff-b813-4f28-9847-dbafc48d2477 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:55.714405 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06410a-0beb-4c90-9d53-c3cdcf4caadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:55.715050 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06410a-0beb-4c90-9d53-c3cdcf4caadc None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:55.715328 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06410a-0beb-4c90-9d53-c3cdcf4caadc None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:55.715595 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06410a-0beb-4c90-9d53-c3cdcf4caadc None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:55.716261 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06410a-0beb-4c90-9d53-c3cdcf4caadc None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:55.716562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06410a-0beb-4c90-9d53-c3cdcf4caadc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:55.717915 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06410a-0beb-4c90-9d53-c3cdcf4caadc None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:55.725744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 272/552] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Aug 19 19:12:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:55.726549 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06410a-0beb-4c90-9d53-c3cdcf4caadc None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:55.729502 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698ad80-110e-4b7f-a338-e270d0445207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:55.730194 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698ad80-110e-4b7f-a338-e270d0445207 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:55.730763 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698ad80-110e-4b7f-a338-e270d0445207 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:55.731105 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698ad80-110e-4b7f-a338-e270d0445207 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:55.742678 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698ad80-110e-4b7f-a338-e270d0445207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:55.747833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-7698ad80-110e-4b7f-a338-e270d0445207 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:12:55.747833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:55.747833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:55.747833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:55.747833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:55.747833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:55.747833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:55.747833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:55.747833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:55.747833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:55.747833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:55.747833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:55.747833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:55.747833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:55.747833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:55.747833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:55.748889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:55.748889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:55.748889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:55.748889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:55.748889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:55.748889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:55.748889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:55.748889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:55.748889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:55.748889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:55.748889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:55.748889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:55.748889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:55.748889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:55.748889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:55.748889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:55.749879 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:55.749879 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:55.749879 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:55.749879 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:55.749879 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:55.749879 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:55.749879 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:55.749879 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:55.749879 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:55.749879 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:55.749879 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:12:55.749879 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:55.749879 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 281/553] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Aug 19 19:12:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:55.750591 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698ad80-110e-4b7f-a338-e270d0445207 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:55.830230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06410a-0beb-4c90-9d53-c3cdcf4caadc None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:55.848041 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698ad80-110e-4b7f-a338-e270d0445207 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:55.849560 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:55.864013 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacbffb-7f73-4dee-84a9-392070ae4ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:55.864626 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacbffb-7f73-4dee-84a9-392070ae4ea6 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:55.864907 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacbffb-7f73-4dee-84a9-392070ae4ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:55.865185 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacbffb-7f73-4dee-84a9-392070ae4ea6 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:55.865821 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacbffb-7f73-4dee-84a9-392070ae4ea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:55.866118 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacbffb-7f73-4dee-84a9-392070ae4ea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:55.867559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacbffb-7f73-4dee-84a9-392070ae4ea6 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:55.879441 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 273/554] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:55.880247 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacbffb-7f73-4dee-84a9-392070ae4ea6 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:55.887251 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25933709-e059-4d0a-9cad-e610e92456ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:55.887877 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25933709-e059-4d0a-9cad-e610e92456ca None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:55.889310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25933709-e059-4d0a-9cad-e610e92456ca None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:55.889310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25933709-e059-4d0a-9cad-e610e92456ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:55.890479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:55.896136 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25933709-e059-4d0a-9cad-e610e92456ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:55.897573 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25933709-e059-4d0a-9cad-e610e92456ca None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:55.908803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-25933709-e059-4d0a-9cad-e610e92456ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:12:55.908803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:55.908803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:55.908803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:55.908803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:55.908803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:55.908803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:55.908803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:55.908803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:55.908803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:55.908803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:55.908803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:55.908803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:12:55.908803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:12:55.908803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:12:55.909797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:12:55.909797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:55.909797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:55.909797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:55.909797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:55.909797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:55.909797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:55.909797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:55.909797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:55.909797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:55.909797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:55.909797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:55.909797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:55.909797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:55.909797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:55.909797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:55.909797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:55.910938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:12:55.910938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:12:55.910938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:12:55.910938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:12:55.910938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:12:55.910938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:12:55.910938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:12:55.910938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:12:55.910938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 282/555] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:12:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:55.911557 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25933709-e059-4d0a-9cad-e610e92456ca None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:55.983612 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacbffb-7f73-4dee-84a9-392070ae4ea6 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:56.011935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25933709-e059-4d0a-9cad-e610e92456ca None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:56.018595 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6602f1e-1b54-45d7-a09f-2fa5ba2fa7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:56.019227 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6602f1e-1b54-45d7-a09f-2fa5ba2fa7b3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:56.019510 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6602f1e-1b54-45d7-a09f-2fa5ba2fa7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:56.019778 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6602f1e-1b54-45d7-a09f-2fa5ba2fa7b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:56.030268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6602f1e-1b54-45d7-a09f-2fa5ba2fa7b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:56.032192 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6602f1e-1b54-45d7-a09f-2fa5ba2fa7b3 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:56.045189 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33270f84-004a-4689-8b14-99e4ed571bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:56.045778 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33270f84-004a-4689-8b14-99e4ed571bfc None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:56.046046 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33270f84-004a-4689-8b14-99e4ed571bfc None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:56.046308 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33270f84-004a-4689-8b14-99e4ed571bfc None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:56.046409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-a6602f1e-1b54-45d7-a09f-2fa5ba2fa7b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:56.046409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:56.046409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:56.046409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:56.046409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:56.046409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:56.046409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:56.046409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:56.046409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:56.046409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:56.046409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:56.046409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:56.046409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:56.046409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:56.046409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:56.046409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:56.052091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:56.052091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:56.052091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:56.052091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:56.052091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:56.052091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:56.052091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:56.052091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:56.052091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:56.052091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:56.052091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:56.052091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:56.052091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:56.052091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:56.052091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:56.052091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:56.052091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:56.053021 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:56.053021 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:56.053021 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:56.053279 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33270f84-004a-4689-8b14-99e4ed571bfc None admin] RBAC: Adding query filter params (name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:56.053279 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33270f84-004a-4689-8b14-99e4ed571bfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:56.053413 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 274/556] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:56.053488 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33270f84-004a-4689-8b14-99e4ed571bfc None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:56.053564 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6602f1e-1b54-45d7-a09f-2fa5ba2fa7b3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:56.057056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 283/557] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Aug 19 19:12:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:56.057848 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33270f84-004a-4689-8b14-99e4ed571bfc None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:56.083317 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:56.114042 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:56.151840 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6602f1e-1b54-45d7-a09f-2fa5ba2fa7b3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:56.157817 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33270f84-004a-4689-8b14-99e4ed571bfc None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:56.186511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93d3b8-f30a-4437-bdac-c5de1ae0c8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:56.187165 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93d3b8-f30a-4437-bdac-c5de1ae0c8f0 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:56.187443 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93d3b8-f30a-4437-bdac-c5de1ae0c8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:56.187719 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93d3b8-f30a-4437-bdac-c5de1ae0c8f0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:56.192535 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fae08-7bf4-484d-b5dc-57a8cf72bf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:56.193157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fae08-7bf4-484d-b5dc-57a8cf72bf62 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:56.193431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fae08-7bf4-484d-b5dc-57a8cf72bf62 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:56.193698 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fae08-7bf4-484d-b5dc-57a8cf72bf62 None admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:56.194376 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fae08-7bf4-484d-b5dc-57a8cf72bf62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:56.194706 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fae08-7bf4-484d-b5dc-57a8cf72bf62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:56.195378 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93d3b8-f30a-4437-bdac-c5de1ae0c8f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:56.196226 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fae08-7bf4-484d-b5dc-57a8cf72bf62 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:56.196838 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93d3b8-f30a-4437-bdac-c5de1ae0c8f0 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:56.209090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 284/558] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:12:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:56.209900 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fae08-7bf4-484d-b5dc-57a8cf72bf62 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:56.211299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-5e93d3b8-f30a-4437-bdac-c5de1ae0c8f0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 19:12:56.211299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:56.211299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:56.211299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:56.211299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:56.211299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:56.211299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:56.211299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:56.211299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:56.211299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:56.211299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:56.211299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:56.211299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:12:56.211299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:12:56.211299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:12:56.211299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:12:56.212785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:56.212785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:56.212785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:12:56.212785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:12:56.212785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:12:56.212785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:12:56.212785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:56.212785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:56.212785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:56.212785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:56.212785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:56.212785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:56.212785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:56.212785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:56.212785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:56.212785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:56.212785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:56.212785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:56.213687 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:56.213687 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:56.213687 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:12:56.213687 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:12:56.213687 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:12:56.213687 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:12:56.213687 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:12:56.213687 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:12:56.213687 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 19:12:56.213687 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:56.213687 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 275/559] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:56.214279 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93d3b8-f30a-4437-bdac-c5de1ae0c8f0 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:56.308618 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:56.315907 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fae08-7bf4-484d-b5dc-57a8cf72bf62 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:56.317740 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93d3b8-f30a-4437-bdac-c5de1ae0c8f0 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:56.332865 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:56.350094 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708327f-19e7-406a-b32b-ce51746c901e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:56.350721 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708327f-19e7-406a-b32b-ce51746c901e None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:56.351004 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708327f-19e7-406a-b32b-ce51746c901e None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:56.351277 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708327f-19e7-406a-b32b-ce51746c901e None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:56.352157 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5823a35-8bd0-4268-8584-2048eb2780ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:56.352513 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708327f-19e7-406a-b32b-ce51746c901e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:56.352818 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708327f-19e7-406a-b32b-ce51746c901e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:56.352913 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5823a35-8bd0-4268-8584-2048eb2780ef None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:56.353103 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5823a35-8bd0-4268-8584-2048eb2780ef None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:56.353371 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5823a35-8bd0-4268-8584-2048eb2780ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:56.354213 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708327f-19e7-406a-b32b-ce51746c901e None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:56.363938 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5823a35-8bd0-4268-8584-2048eb2780ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:56.365362 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5823a35-8bd0-4268-8584-2048eb2780ef None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:56.366981 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 285/560] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:56.368480 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708327f-19e7-406a-b32b-ce51746c901e None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:56.380412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-d5823a35-8bd0-4268-8584-2048eb2780ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:56.380412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:56.380412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:56.380412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:56.380412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:56.380412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:56.380412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:56.380412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:56.380412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:56.380412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:56.380412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:56.380412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:56.380412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:56.380412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:56.380412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:56.380412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:56.381523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:56.381523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:56.381523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:56.381523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:56.381523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:56.381523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:56.381523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:56.381523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:56.381523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:56.381523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:56.381523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:56.381523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:56.381523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:56.381523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:56.381523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:56.381523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:56.381523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:56.387276 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:56.387276 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:56.387276 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:56.387276 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 276/561] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:56.387276 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5823a35-8bd0-4268-8584-2048eb2780ef None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:56.475001 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708327f-19e7-406a-b32b-ce51746c901e None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:56.492069 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5823a35-8bd0-4268-8584-2048eb2780ef None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:56.510571 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e6722-0ad9-4857-b4f7-360880ad2b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:56.511343 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e6722-0ad9-4857-b4f7-360880ad2b25 None admin] REQUEST_METHOD: `PUT` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:56.511617 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e6722-0ad9-4857-b4f7-360880ad2b25 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:56.511915 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e6722-0ad9-4857-b4f7-360880ad2b25 None admin] PATH_INFO: `/v3/projects/409a043500554125a93c4636db5a6812/users/54c899e786614c18b2bf4334ceb2f891/roles/1201f07f50a74488936b4eba2ba9a82c` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:56.526398 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e6722-0ad9-4857-b4f7-360880ad2b25 None admin] RBAC: Authorizing `identity:create_grant(project_id=409a043500554125a93c4636db5a6812, user_id=54c899e786614c18b2bf4334ceb2f891, role_id=1201f07f50a74488936b4eba2ba9a82c)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:56.527869 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e6722-0ad9-4857-b4f7-360880ad2b25 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:56.531756 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72c26b-0a88-4d56-a26c-a75a1a581a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:56.532365 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72c26b-0a88-4d56-a26c-a75a1a581a08 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:56.532644 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72c26b-0a88-4d56-a26c-a75a1a581a08 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:56.532917 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72c26b-0a88-4d56-a26c-a75a1a581a08 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:56.533651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72c26b-0a88-4d56-a26c-a75a1a581a08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:56.533945 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72c26b-0a88-4d56-a26c-a75a1a581a08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:56.535388 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72c26b-0a88-4d56-a26c-a75a1a581a08 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:56.552349 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 277/562] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Aug 19 19:12:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:56.553153 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72c26b-0a88-4d56-a26c-a75a1a581a08 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:56.556218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:56.620253 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 286/563] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Aug 19 19:12:56 2022] PUT /identity/v3/projects/409a043500554125a93c4636db5a6812/users/54c899e786614c18b2bf4334ceb2f891/roles/1201f07f50a74488936b4eba2ba9a82c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:12:56.621014 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e6722-0ad9-4857-b4f7-360880ad2b25 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:56.654787 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:56.662579 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72c26b-0a88-4d56-a26c-a75a1a581a08 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:56.707004 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a61877-fc34-4737-947b-e47c3154ece5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:56.707705 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a61877-fc34-4737-947b-e47c3154ece5 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:56.707988 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a61877-fc34-4737-947b-e47c3154ece5 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:56.708261 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a61877-fc34-4737-947b-e47c3154ece5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:56.717015 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a61877-fc34-4737-947b-e47c3154ece5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:56.718483 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a61877-fc34-4737-947b-e47c3154ece5 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:56.731750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-29a61877-fc34-4737-947b-e47c3154ece5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 19:12:56.731750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:56.731750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:56.731750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:56.731750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:56.731750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:56.731750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:56.731750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:56.731750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:56.731750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:56.731750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:56.731750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:56.731750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:12:56.731750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:12:56.731750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:12:56.731750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:12:56.732744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:56.732744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:56.732744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:12:56.732744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:12:56.732744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:12:56.732744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:12:56.732744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:56.732744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:56.732744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:56.732744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:56.732744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:56.732744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:56.732744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:56.732744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:56.732744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:56.732744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:56.732744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:56.732744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:56.734278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:56.734278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:56.734278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:12:56.734278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:12:56.734278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:12:56.734278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:12:56.734278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:12:56.734278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:12:56.734278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 19:12:56.734278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:56.734278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 278/564] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:12:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:56.734278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a61877-fc34-4737-947b-e47c3154ece5 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:56.751681 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e6722-0ad9-4857-b4f7-360880ad2b25 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:56.794507 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cf155-189b-408f-b1fa-cb1d83540a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:56.795150 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cf155-189b-408f-b1fa-cb1d83540a18 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:56.795424 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cf155-189b-408f-b1fa-cb1d83540a18 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:56.795695 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cf155-189b-408f-b1fa-cb1d83540a18 None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:56.796372 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9cf155-189b-408f-b1fa-cb1d83540a18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:56.796674 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9cf155-189b-408f-b1fa-cb1d83540a18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:56.798056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9cf155-189b-408f-b1fa-cb1d83540a18 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:56.812411 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 287/565] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:56.813109 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cf155-189b-408f-b1fa-cb1d83540a18 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:56.815091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:56.862687 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a61877-fc34-4737-947b-e47c3154ece5 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:56.899988 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0116d4d-a49d-45dc-8df4-a91a0969eb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:56.900709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0116d4d-a49d-45dc-8df4-a91a0969eb68 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:56.900984 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0116d4d-a49d-45dc-8df4-a91a0969eb68 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:56.901252 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0116d4d-a49d-45dc-8df4-a91a0969eb68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:56.903898 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:56.912985 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0116d4d-a49d-45dc-8df4-a91a0969eb68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:56.916173 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0116d4d-a49d-45dc-8df4-a91a0969eb68 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:56.920984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cf155-189b-408f-b1fa-cb1d83540a18 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:56.929936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-f0116d4d-a49d-45dc-8df4-a91a0969eb68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:56.929936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:56.929936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:56.929936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:56.929936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:56.929936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:56.929936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:56.929936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:56.929936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:56.929936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:56.929936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:56.929936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:56.929936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:56.929936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:56.929936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:56.929936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:56.931352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:56.931352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:56.931352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:56.931352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:56.931352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:56.931352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:56.931352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:56.931352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:56.931352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:56.931352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:56.931352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:56.931352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:56.931352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:56.931352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:56.931352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:56.931352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:56.931352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:56.932245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:56.932245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:56.932245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:56.936583 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 279/566] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:56.937355 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0116d4d-a49d-45dc-8df4-a91a0969eb68 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:56.961484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba099e4-9129-4e36-b5ad-13be2ac3b3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:56.962094 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba099e4-9129-4e36-b5ad-13be2ac3b3b8 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:56.962391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba099e4-9129-4e36-b5ad-13be2ac3b3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:56.962659 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba099e4-9129-4e36-b5ad-13be2ac3b3b8 None admin] PATH_INFO: `/v3/users` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:56.963382 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba099e4-9129-4e36-b5ad-13be2ac3b3b8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:56.963684 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba099e4-9129-4e36-b5ad-13be2ac3b3b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:56.965116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba099e4-9129-4e36-b5ad-13be2ac3b3b8 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:56.988098 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 288/567] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Aug 19 19:12:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:56.988098 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba099e4-9129-4e36-b5ad-13be2ac3b3b8 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:57.049726 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0116d4d-a49d-45dc-8df4-a91a0969eb68 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:57.064828 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:57.092224 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2260b9-e696-4aa8-8b40-86f786075e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:57.093067 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2260b9-e696-4aa8-8b40-86f786075e92 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:57.093346 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2260b9-e696-4aa8-8b40-86f786075e92 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:57.093622 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2260b9-e696-4aa8-8b40-86f786075e92 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:57.096813 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba099e4-9129-4e36-b5ad-13be2ac3b3b8 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:57.107158 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2260b9-e696-4aa8-8b40-86f786075e92 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:57.109034 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2260b9-e696-4aa8-8b40-86f786075e92 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:57.121218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-cb2260b9-e696-4aa8-8b40-86f786075e92 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 19:12:57.121218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:57.121218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:57.121218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:57.121218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:57.121218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:57.121218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:57.121218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:57.121218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:57.121218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:57.121218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:57.121218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:57.121218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:12:57.121218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:12:57.121218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:12:57.121218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:12:57.122209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:57.122209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:57.122209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:12:57.122209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:12:57.122209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:12:57.122209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:12:57.122209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:57.122209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:57.122209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:57.122209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:57.122209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:57.122209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:57.122209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:57.122209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:57.122209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:57.122209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:57.122209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:57.122209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:57.123674 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:57.123674 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:57.123674 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:12:57.123674 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:12:57.123674 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:12:57.123674 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:12:57.123674 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:12:57.123674 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:12:57.123674 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 19:12:57.123674 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:57.123674 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 280/568] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Aug 19 19:12:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:57.123674 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2260b9-e696-4aa8-8b40-86f786075e92 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:57.140183 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f4436-c6f4-45a2-bfa7-6b06cf2be7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:57.140798 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f4436-c6f4-45a2-bfa7-6b06cf2be7aa None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:57.141077 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f4436-c6f4-45a2-bfa7-6b06cf2be7aa None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:57.141344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f4436-c6f4-45a2-bfa7-6b06cf2be7aa None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:57.142092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f4436-c6f4-45a2-bfa7-6b06cf2be7aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:57.142314 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f4436-c6f4-45a2-bfa7-6b06cf2be7aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:57.143796 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f4436-c6f4-45a2-bfa7-6b06cf2be7aa None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:57.156347 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 289/569] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:57.156926 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f4436-c6f4-45a2-bfa7-6b06cf2be7aa None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:57.161425 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:57.233017 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2260b9-e696-4aa8-8b40-86f786075e92 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:57.265815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f4436-c6f4-45a2-bfa7-6b06cf2be7aa None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:57.266903 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf110d-3e8a-4b87-a077-79857ac5ef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:57.267817 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf110d-3e8a-4b87-a077-79857ac5ef1c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:57.268217 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf110d-3e8a-4b87-a077-79857ac5ef1c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:57.268489 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf110d-3e8a-4b87-a077-79857ac5ef1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:57.279936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf110d-3e8a-4b87-a077-79857ac5ef1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:57.281540 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf110d-3e8a-4b87-a077-79857ac5ef1c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:57.297064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-2bbf110d-3e8a-4b87-a077-79857ac5ef1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:57.297064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:57.297064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:57.297064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:57.297064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:57.297064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:57.297064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:57.297064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:57.297064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:57.297064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:57.297064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:57.297064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:57.297064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:57.297064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:57.297064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:57.297064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:57.302905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:57.302905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:57.302905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:57.302905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:57.302905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:57.302905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:57.302905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:57.302905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:57.302905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:57.302905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:57.302905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:57.302905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:57.302905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:57.302905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:57.302905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:57.302905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:57.302905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:57.304001 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:57.304001 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:57.304001 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:57.304001 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 281/570] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:57.304001 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf110d-3e8a-4b87-a077-79857ac5ef1c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:57.308784 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac20b78-940a-443a-8d0c-e2193f58ac98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:57.309579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac20b78-940a-443a-8d0c-e2193f58ac98 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:57.310026 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac20b78-940a-443a-8d0c-e2193f58ac98 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:57.310453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac20b78-940a-443a-8d0c-e2193f58ac98 None admin] PATH_INFO: `/v3/users` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:57.311709 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac20b78-940a-443a-8d0c-e2193f58ac98 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:57.312362 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac20b78-940a-443a-8d0c-e2193f58ac98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:57.313983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac20b78-940a-443a-8d0c-e2193f58ac98 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:57.330966 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:57.332151 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 290/571] 10.222.0.61 () {56 vars in 1139 bytes} [Fri Aug 19 19:12:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:57.335696 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac20b78-940a-443a-8d0c-e2193f58ac98 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:57.398404 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:57.408161 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf110d-3e8a-4b87-a077-79857ac5ef1c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:57.437945 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac20b78-940a-443a-8d0c-e2193f58ac98 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:57.444186 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399c5dd-81b6-4761-b6fc-ba9cabd7b91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:57.444932 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399c5dd-81b6-4761-b6fc-ba9cabd7b91e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:57.445304 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399c5dd-81b6-4761-b6fc-ba9cabd7b91e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:57.445693 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399c5dd-81b6-4761-b6fc-ba9cabd7b91e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:57.452540 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399c5dd-81b6-4761-b6fc-ba9cabd7b91e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:57.454104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399c5dd-81b6-4761-b6fc-ba9cabd7b91e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:57.465584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-5399c5dd-81b6-4761-b6fc-ba9cabd7b91e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:12:57.465584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:57.465584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:57.465584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:57.465584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:57.465584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:57.465584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:57.465584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:57.465584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:57.465584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:57.465584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:57.465584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:57.465584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:12:57.465584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:12:57.465584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:12:57.466655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:12:57.466655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:57.466655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:57.466655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:57.466655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:57.466655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:57.466655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:57.466655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:57.466655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:57.466655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:57.466655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:57.466655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:57.466655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:57.466655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:57.466655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:57.466655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:57.466655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:57.467714 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:12:57.467714 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:12:57.467714 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:12:57.467714 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:12:57.467714 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:12:57.467714 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:12:57.467714 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:12:57.467714 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:57.469277 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 282/572] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:12:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:57.469921 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399c5dd-81b6-4761-b6fc-ba9cabd7b91e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:57.481456 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2d912-9c2b-4f6c-b4de-d2a5ad99b54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:57.482063 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2d912-9c2b-4f6c-b4de-d2a5ad99b54c None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:57.482351 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2d912-9c2b-4f6c-b4de-d2a5ad99b54c None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:57.482639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2d912-9c2b-4f6c-b4de-d2a5ad99b54c None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:57.483286 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2d912-9c2b-4f6c-b4de-d2a5ad99b54c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:57.483582 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2d912-9c2b-4f6c-b4de-d2a5ad99b54c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:57.484967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2d912-9c2b-4f6c-b4de-d2a5ad99b54c None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:57.497712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 291/573] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:57.498383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2d912-9c2b-4f6c-b4de-d2a5ad99b54c None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:57.567119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:57.587880 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399c5dd-81b6-4761-b6fc-ba9cabd7b91e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:57.607087 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2d912-9c2b-4f6c-b4de-d2a5ad99b54c None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:57.623753 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12db28-7984-4c1c-8b3c-2a24cd9bf9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:57.624382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12db28-7984-4c1c-8b3c-2a24cd9bf9fb None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:57.624658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12db28-7984-4c1c-8b3c-2a24cd9bf9fb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:57.624927 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12db28-7984-4c1c-8b3c-2a24cd9bf9fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:57.632436 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:57.636797 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12db28-7984-4c1c-8b3c-2a24cd9bf9fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:57.638298 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12db28-7984-4c1c-8b3c-2a24cd9bf9fb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:57.646256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a597398-bf6f-43f3-ba98-8700b5547c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:57.646895 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a597398-bf6f-43f3-ba98-8700b5547c20 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:57.647212 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a597398-bf6f-43f3-ba98-8700b5547c20 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:57.647434 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a597398-bf6f-43f3-ba98-8700b5547c20 None admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:57.648310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a597398-bf6f-43f3-ba98-8700b5547c20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:57.648416 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a597398-bf6f-43f3-ba98-8700b5547c20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:57.649868 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a597398-bf6f-43f3-ba98-8700b5547c20 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:57.652775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-4b12db28-7984-4c1c-8b3c-2a24cd9bf9fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:57.652775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:57.652775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:57.652775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:57.652775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:57.652775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:57.652775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:57.652775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:57.652775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:57.652775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:57.652775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:57.652775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:57.652775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:57.652775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:57.652775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:57.652775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:57.653695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:57.653695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:57.653695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:57.653695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:57.653695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:57.653695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:57.653695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:57.653695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:57.653695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:57.653695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:57.653695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:57.653695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:57.653695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:57.653695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:57.653695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:57.653695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:57.653695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:57.659440 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:57.659440 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:57.659440 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:57.659440 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 283/574] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:57.659440 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12db28-7984-4c1c-8b3c-2a24cd9bf9fb None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:57.670993 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 292/575] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:12:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:57.671903 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a597398-bf6f-43f3-ba98-8700b5547c20 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:57.769959 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12db28-7984-4c1c-8b3c-2a24cd9bf9fb None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:57.783472 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a597398-bf6f-43f3-ba98-8700b5547c20 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:57.811548 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f8c14-3fa3-418c-8bf2-723017c64af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:57.812459 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f8c14-3fa3-418c-8bf2-723017c64af1 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:57.813055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f8c14-3fa3-418c-8bf2-723017c64af1 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:57.813762 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f8c14-3fa3-418c-8bf2-723017c64af1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:57.822056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279318d-2531-43cd-a11e-4e90d6060472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:57.822806 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279318d-2531-43cd-a11e-4e90d6060472 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:57.823152 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279318d-2531-43cd-a11e-4e90d6060472 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:57.823491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279318d-2531-43cd-a11e-4e90d6060472 None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:57.823785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f8c14-3fa3-418c-8bf2-723017c64af1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:57.824591 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b279318d-2531-43cd-a11e-4e90d6060472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:57.824591 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b279318d-2531-43cd-a11e-4e90d6060472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:57.825436 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f8c14-3fa3-418c-8bf2-723017c64af1 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:57.826144 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b279318d-2531-43cd-a11e-4e90d6060472 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:57.827531 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:57.838089 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 293/576] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:57.841615 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279318d-2531-43cd-a11e-4e90d6060472 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:57.841718 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-f80f8c14-3fa3-418c-8bf2-723017c64af1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:12:57.841718 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:57.841718 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:57.841718 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:57.841718 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:57.841718 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:57.841718 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:57.841718 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:57.841718 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:57.841718 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:57.841718 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:57.841718 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:57.841718 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:12:57.841718 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:12:57.841718 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:12:57.842590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:12:57.842590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:57.842590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:57.842590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:57.842590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:57.842590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:57.842590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:57.842590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:57.842590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:57.842590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:57.842590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:57.842590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:57.842590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:57.842590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:57.842590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:57.842590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:57.842590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:57.843519 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:12:57.843519 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:12:57.843519 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:12:57.843519 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:12:57.843519 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:12:57.843519 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:12:57.843519 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:12:57.843519 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:57.845522 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 284/577] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:12:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:57.846359 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f8c14-3fa3-418c-8bf2-723017c64af1 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:57.885696 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:57.946450 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279318d-2531-43cd-a11e-4e90d6060472 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:57.955752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f8c14-3fa3-418c-8bf2-723017c64af1 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:57.980996 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907fa69-9a30-45d9-a652-27a75ba072b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:57.981699 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907fa69-9a30-45d9-a652-27a75ba072b9 None admin] REQUEST_METHOD: `PUT` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:57.981957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907fa69-9a30-45d9-a652-27a75ba072b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:57.982232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907fa69-9a30-45d9-a652-27a75ba072b9 None admin] PATH_INFO: `/v3/projects/409a043500554125a93c4636db5a6812/users/1bca70a332304359bcc9d873ebbe14de/roles/1201f07f50a74488936b4eba2ba9a82c` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:57.989244 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9de36-9a2e-439c-a106-599b91c53985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:57.989861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9de36-9a2e-439c-a106-599b91c53985 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:57.990137 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9de36-9a2e-439c-a106-599b91c53985 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:57.990406 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9de36-9a2e-439c-a106-599b91c53985 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:57.997728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9de36-9a2e-439c-a106-599b91c53985 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:57.997869 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907fa69-9a30-45d9-a652-27a75ba072b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=409a043500554125a93c4636db5a6812, user_id=1bca70a332304359bcc9d873ebbe14de, role_id=1201f07f50a74488936b4eba2ba9a82c)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:57.999207 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907fa69-9a30-45d9-a652-27a75ba072b9 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:57.999307 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9de36-9a2e-439c-a106-599b91c53985 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:58.010607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-74e9de36-9a2e-439c-a106-599b91c53985 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:12:58.010607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:58.010607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:58.010607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:58.010607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:58.010607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:58.010607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:58.010607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:58.010607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:58.010607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:58.010607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:58.010607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:58.010607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:12:58.010607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:12:58.010607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:12:58.011745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:12:58.011745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:58.011745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:58.011745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:58.011745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:58.011745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:58.011745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:58.011745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:58.011745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:58.011745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:58.011745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:58.011745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:58.011745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:58.011745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:58.011745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:58.011745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:58.011745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:58.012677 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:12:58.012677 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:12:58.012677 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:12:58.012677 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:12:58.012677 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:12:58.012677 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:12:58.012677 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:12:58.012677 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:58.012677 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 285/578] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:12:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:58.012677 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9de36-9a2e-439c-a106-599b91c53985 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:58.070184 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:58.072259 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 294/579] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Aug 19 19:12:57 2022] PUT /identity/v3/projects/409a043500554125a93c4636db5a6812/users/1bca70a332304359bcc9d873ebbe14de/roles/1201f07f50a74488936b4eba2ba9a82c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:12:58.076414 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907fa69-9a30-45d9-a652-27a75ba072b9 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:58.150335 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9de36-9a2e-439c-a106-599b91c53985 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:58.190103 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acf032-55ad-472d-a4ef-69fc2f3ab054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:58.191115 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acf032-55ad-472d-a4ef-69fc2f3ab054 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:58.191861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acf032-55ad-472d-a4ef-69fc2f3ab054 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:58.192328 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acf032-55ad-472d-a4ef-69fc2f3ab054 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:58.193328 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acf032-55ad-472d-a4ef-69fc2f3ab054 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:58.193837 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acf032-55ad-472d-a4ef-69fc2f3ab054 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:58.195547 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acf032-55ad-472d-a4ef-69fc2f3ab054 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:58.210195 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 286/580] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:12:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:58.218685 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acf032-55ad-472d-a4ef-69fc2f3ab054 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:58.222274 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:58.229615 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907fa69-9a30-45d9-a652-27a75ba072b9 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:58.273261 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79153e5-0d7f-4ea1-90ff-944950293fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:58.273906 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79153e5-0d7f-4ea1-90ff-944950293fd0 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:58.274184 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79153e5-0d7f-4ea1-90ff-944950293fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:58.274456 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79153e5-0d7f-4ea1-90ff-944950293fd0 None admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:58.275185 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79153e5-0d7f-4ea1-90ff-944950293fd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:58.275540 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79153e5-0d7f-4ea1-90ff-944950293fd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:58.277089 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79153e5-0d7f-4ea1-90ff-944950293fd0 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:58.291775 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 295/581] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:12:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:58.297658 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79153e5-0d7f-4ea1-90ff-944950293fd0 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:58.351271 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acf032-55ad-472d-a4ef-69fc2f3ab054 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:58.371332 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:58.389316 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c40b9-a027-4fd6-8525-b4750317dcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:58.389985 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c40b9-a027-4fd6-8525-b4750317dcd1 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:58.390262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c40b9-a027-4fd6-8525-b4750317dcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:58.390550 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c40b9-a027-4fd6-8525-b4750317dcd1 None admin] PATH_INFO: `/v3/projects/409a043500554125a93c4636db5a6812/users/23bbd8bfe6924ea2a6fd35513f830cb4/roles/1201f07f50a74488936b4eba2ba9a82c` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:58.406950 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c40b9-a027-4fd6-8525-b4750317dcd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=409a043500554125a93c4636db5a6812, user_id=23bbd8bfe6924ea2a6fd35513f830cb4, role_id=1201f07f50a74488936b4eba2ba9a82c)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:58.408433 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c40b9-a027-4fd6-8525-b4750317dcd1 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:58.436474 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79153e5-0d7f-4ea1-90ff-944950293fd0 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:58.475417 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e8aa3-c715-4b72-864a-e8ac70e690e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:58.475992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e8aa3-c715-4b72-864a-e8ac70e690e1 None admin] REQUEST_METHOD: `PUT` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:58.476274 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e8aa3-c715-4b72-864a-e8ac70e690e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:58.476545 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e8aa3-c715-4b72-864a-e8ac70e690e1 None admin] PATH_INFO: `/v3/projects/409a043500554125a93c4636db5a6812/users/84bd0bde9a164516a26768a3eb44fdec/roles/1201f07f50a74488936b4eba2ba9a82c` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:58.491823 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 287/582] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Aug 19 19:12:58 2022] PUT /identity/v3/projects/409a043500554125a93c4636db5a6812/users/23bbd8bfe6924ea2a6fd35513f830cb4/roles/1201f07f50a74488936b4eba2ba9a82c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:12:58.492164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e8aa3-c715-4b72-864a-e8ac70e690e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=409a043500554125a93c4636db5a6812, user_id=84bd0bde9a164516a26768a3eb44fdec, role_id=1201f07f50a74488936b4eba2ba9a82c)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:58.494171 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e8aa3-c715-4b72-864a-e8ac70e690e1 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:58.577870 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 296/583] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Aug 19 19:12:58 2022] PUT /identity/v3/projects/409a043500554125a93c4636db5a6812/users/84bd0bde9a164516a26768a3eb44fdec/roles/1201f07f50a74488936b4eba2ba9a82c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 19:12:58.887232 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea940c1e-6a35-4a2f-bfff-9d4561eb0ad9 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:58.887961 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea940c1e-6a35-4a2f-bfff-9d4561eb0ad9 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:58.887961 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea940c1e-6a35-4a2f-bfff-9d4561eb0ad9 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:58.889409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 288/584] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:12:58.903101 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ff153-3f5e-4830-90b1-8d89a14b7a27 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:58.903724 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ff153-3f5e-4830-90b1-8d89a14b7a27 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:58.903724 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ff153-3f5e-4830-90b1-8d89a14b7a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:58.910129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:58.922934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-519ff153-3f5e-4830-90b1-8d89a14b7a27 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:12:58.924141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-519ff153-3f5e-4830-90b1-8d89a14b7a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:12:58.997387 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 297/585] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:12:59.329697 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea940c1e-6a35-4a2f-bfff-9d4561eb0ad9 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:59.446797 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea940c1e-6a35-4a2f-bfff-9d4561eb0ad9 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:59.486764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d996f7-61a4-4edf-8800-91793f91a1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:59.487478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d996f7-61a4-4edf-8800-91793f91a1c3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:59.487755 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d996f7-61a4-4edf-8800-91793f91a1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:59.488026 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d996f7-61a4-4edf-8800-91793f91a1c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:59.519944 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d996f7-61a4-4edf-8800-91793f91a1c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:12:59.524827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-96d996f7-61a4-4edf-8800-91793f91a1c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:12:59.524827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:59.524827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:59.524827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:59.524827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:59.524827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:59.524827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:59.524827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:59.524827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:59.524827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:59.524827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:59.524827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:59.524827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:12:59.524827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:12:59.524827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:12:59.524827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:12:59.526918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:12:59.526918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:12:59.526918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:12:59.526918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:12:59.526918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:59.526918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:59.526918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:59.526918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:59.526918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:59.526918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:59.526918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:59.526918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:59.526918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:59.526918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:59.526918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:59.526918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:59.528666 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:59.528666 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:59.528666 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:59.528666 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:59.528666 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:12:59.528666 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:12:59.528666 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:12:59.528666 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:12:59.528666 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:12:59.528666 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:12:59.528666 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:12:59.528666 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:59.528666 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 289/586] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Aug 19 19:12:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:59.532041 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ff153-3f5e-4830-90b1-8d89a14b7a27 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:59.651563 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ff153-3f5e-4830-90b1-8d89a14b7a27 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:59.684345 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:59.689189 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef88cf-d65a-46c7-9813-c4ae1f7cea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:59.689827 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef88cf-d65a-46c7-9813-c4ae1f7cea90 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:59.690102 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef88cf-d65a-46c7-9813-c4ae1f7cea90 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:59.690374 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef88cf-d65a-46c7-9813-c4ae1f7cea90 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:59.691061 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef88cf-d65a-46c7-9813-c4ae1f7cea90 None admin] RBAC: Adding query filter params (name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:12:59.691615 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef88cf-d65a-46c7-9813-c4ae1f7cea90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:59.693000 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef88cf-d65a-46c7-9813-c4ae1f7cea90 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:59.701888 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 298/587] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Aug 19 19:12:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:12:59.707269 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d996f7-61a4-4edf-8800-91793f91a1c3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:12:59.743857 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:12:59.824945 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d996f7-61a4-4edf-8800-91793f91a1c3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:12:59.865879 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58829b2-5288-4b6a-9e84-eb4228c9a659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:12:59.866515 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58829b2-5288-4b6a-9e84-eb4228c9a659 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:12:59.866832 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58829b2-5288-4b6a-9e84-eb4228c9a659 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:12:59.867105 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58829b2-5288-4b6a-9e84-eb4228c9a659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:12:59.878136 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58829b2-5288-4b6a-9e84-eb4228c9a659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:12:59.879610 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58829b2-5288-4b6a-9e84-eb4228c9a659 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:12:59.894336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-e58829b2-5288-4b6a-9e84-eb4228c9a659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:59.894336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:12:59.894336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:12:59.894336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:12:59.894336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:12:59.894336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:12:59.894336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:12:59.894336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:12:59.894336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:12:59.894336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:12:59.894336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:12:59.894336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:12:59.894336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:12:59.894336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:12:59.894336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:12:59.894336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:12:59.896905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:12:59.896905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:12:59.896905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:12:59.896905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:12:59.896905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:12:59.896905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:12:59.896905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:12:59.896905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:12:59.896905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:12:59.896905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:12:59.896905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:12:59.896905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:12:59.896905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:12:59.896905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:12:59.896905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:12:59.896905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:12:59.896905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:12:59.899208 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:12:59.899208 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:12:59.899208 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:12:59.899208 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 290/588] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:12:59.903971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef88cf-d65a-46c7-9813-c4ae1f7cea90 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:00.052916 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef88cf-d65a-46c7-9813-c4ae1f7cea90 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:00.090117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bb907-4b84-451d-9ca7-45e2fc849a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:00.090758 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bb907-4b84-451d-9ca7-45e2fc849a6d None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:00.091039 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bb907-4b84-451d-9ca7-45e2fc849a6d None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:00.091373 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bb907-4b84-451d-9ca7-45e2fc849a6d None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:00.092015 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bb907-4b84-451d-9ca7-45e2fc849a6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:00.092321 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bb907-4b84-451d-9ca7-45e2fc849a6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:00.093757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bb907-4b84-451d-9ca7-45e2fc849a6d None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:00.107455 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 299/589] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:00.113113 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58829b2-5288-4b6a-9e84-eb4228c9a659 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:00.246684 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:00.267244 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58829b2-5288-4b6a-9e84-eb4228c9a659 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:00.303626 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a43eb-e16e-478f-a0b4-2e6595b66a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:00.304275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a43eb-e16e-478f-a0b4-2e6595b66a34 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:00.304555 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a43eb-e16e-478f-a0b4-2e6595b66a34 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:00.305348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a43eb-e16e-478f-a0b4-2e6595b66a34 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:00.313873 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a43eb-e16e-478f-a0b4-2e6595b66a34 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:00.315416 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a43eb-e16e-478f-a0b4-2e6595b66a34 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:00.328804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-f74a43eb-e16e-478f-a0b4-2e6595b66a34 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:13:00.328804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:00.328804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:00.328804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:00.328804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:00.328804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:00.328804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:00.328804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:00.328804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:00.328804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:00.328804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:00.328804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:00.328804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:13:00.328804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:13:00.328804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:13:00.328804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:13:00.329779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:00.329779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:00.329779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:13:00.329779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:13:00.329779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:13:00.329779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:13:00.329779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:00.329779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:00.329779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:00.329779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:00.329779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:00.329779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:00.329779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:00.329779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:00.329779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:00.329779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:00.329779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:00.329779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:00.330728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:00.330728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:00.330728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:13:00.330728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:13:00.330728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:13:00.330728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:13:00.330728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:13:00.330728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:13:00.330728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:13:00.330728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:00.330728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 291/590] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Aug 19 19:13:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:00.335746 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bb907-4b84-451d-9ca7-45e2fc849a6d None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:00.396951 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:00.452927 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bb907-4b84-451d-9ca7-45e2fc849a6d None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:00.503979 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703a95b-7918-4bcb-ae1e-a3d16f4df205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:00.505406 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703a95b-7918-4bcb-ae1e-a3d16f4df205 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:00.505406 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703a95b-7918-4bcb-ae1e-a3d16f4df205 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:00.505406 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703a95b-7918-4bcb-ae1e-a3d16f4df205 None admin] PATH_INFO: `/v3/users` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:00.510552 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703a95b-7918-4bcb-ae1e-a3d16f4df205 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:00.510552 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703a95b-7918-4bcb-ae1e-a3d16f4df205 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:00.510552 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703a95b-7918-4bcb-ae1e-a3d16f4df205 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:00.550920 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a43eb-e16e-478f-a0b4-2e6595b66a34 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:00.554151 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 300/591] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Aug 19 19:13:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:00.589558 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36084b-d08d-4f8b-85ec-035bc532e2fd None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:00.589845 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36084b-d08d-4f8b-85ec-035bc532e2fd None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:00.590126 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36084b-d08d-4f8b-85ec-035bc532e2fd None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:00.591601 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 301/592] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:13:00.596671 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac898b17-ae13-405e-a569-884af96d68e4 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:00.597110 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac898b17-ae13-405e-a569-884af96d68e4 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:00.597486 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac898b17-ae13-405e-a569-884af96d68e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:00.634572 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-ac898b17-ae13-405e-a569-884af96d68e4 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:00.634572 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-ac898b17-ae13-405e-a569-884af96d68e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:00.738558 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a43eb-e16e-478f-a0b4-2e6595b66a34 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:00.753334 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 302/593] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:13:00.803879 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322e05b-5fef-4197-8b97-c6c709d4ba67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:00.804499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322e05b-5fef-4197-8b97-c6c709d4ba67 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:00.804919 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322e05b-5fef-4197-8b97-c6c709d4ba67 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:00.805904 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322e05b-5fef-4197-8b97-c6c709d4ba67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:00.818352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:00.865243 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cf1dc-48e8-48c4-9d1d-8cef9176aaf9 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:00.865567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cf1dc-48e8-48c4-9d1d-8cef9176aaf9 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:00.865847 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cf1dc-48e8-48c4-9d1d-8cef9176aaf9 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:00.868433 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 303/594] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:13:00.878914 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a3fe8-bf38-4ac9-9950-c5b4f0e1995a None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:00.879783 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a3fe8-bf38-4ac9-9950-c5b4f0e1995a None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:00.880165 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a3fe8-bf38-4ac9-9950-c5b4f0e1995a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:00.886806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322e05b-5fef-4197-8b97-c6c709d4ba67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:00.888469 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322e05b-5fef-4197-8b97-c6c709d4ba67 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:00.905066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-0a3a3fe8-bf38-4ac9-9950-c5b4f0e1995a None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:00.907272 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-0a3a3fe8-bf38-4ac9-9950-c5b4f0e1995a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:00.958108 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:00.995782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 304/595] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:13:00.997034 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae45cb-a0e2-4b3d-b2f1-f7feb25ed295 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:00.997313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae45cb-a0e2-4b3d-b2f1-f7feb25ed295 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:00.997582 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae45cb-a0e2-4b3d-b2f1-f7feb25ed295 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:01.002900 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 305/596] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:01.003971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb26b4a-ba9f-42cc-a744-64790f4fe2ef None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:01.004253 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb26b4a-ba9f-42cc-a744-64790f4fe2ef None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:01.004526 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb26b4a-ba9f-42cc-a744-64790f4fe2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:01.009774 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 292/597] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:13:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:13:01.015132 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322e05b-5fef-4197-8b97-c6c709d4ba67 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:01.025863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-7eb26b4a-ba9f-42cc-a744-64790f4fe2ef None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:01.027105 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-7eb26b4a-ba9f-42cc-a744-64790f4fe2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:01.072456 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:01.098546 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 306/598] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:13:01.100513 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb26b4a-ba9f-42cc-a744-64790f4fe2ef None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:01.144608 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322e05b-5fef-4197-8b97-c6c709d4ba67 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:01.180289 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a9835-2c9f-45ef-9dfb-d187b031c8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:01.181091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a9835-2c9f-45ef-9dfb-d187b031c8ca None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:01.181478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a9835-2c9f-45ef-9dfb-d187b031c8ca None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:01.181861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a9835-2c9f-45ef-9dfb-d187b031c8ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:01.192809 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a9835-2c9f-45ef-9dfb-d187b031c8ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:01.194356 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a9835-2c9f-45ef-9dfb-d187b031c8ca None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:01.209704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-247a9835-2c9f-45ef-9dfb-d187b031c8ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:01.209704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:01.209704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:01.209704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:01.209704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:01.209704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:01.209704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:01.209704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:01.209704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:01.209704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:01.209704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:01.209704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:01.209704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:13:01.209704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:13:01.209704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:13:01.209704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:13:01.210871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:01.210871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:01.210871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:01.210871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:01.210871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:01.210871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:01.210871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:01.210871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:01.210871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:01.210871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:01.210871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:01.210871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:01.210871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:01.210871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:01.210871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:01.210871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:01.210871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:13:01.212942 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:13:01.212942 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:01.212942 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:01.214068 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 293/599] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:01.219534 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a9835-2c9f-45ef-9dfb-d187b031c8ca None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:01.226833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb26b4a-ba9f-42cc-a744-64790f4fe2ef None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:01.228704 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:01.268112 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b31cbf-2058-43d8-bbad-e8732e0f0b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:01.269125 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b31cbf-2058-43d8-bbad-e8732e0f0b85 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:01.269537 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b31cbf-2058-43d8-bbad-e8732e0f0b85 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:01.269978 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b31cbf-2058-43d8-bbad-e8732e0f0b85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:01.282177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b31cbf-2058-43d8-bbad-e8732e0f0b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:13:01.287536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-02b31cbf-2058-43d8-bbad-e8732e0f0b85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:13:01.287536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:01.287536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:01.287536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:01.287536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:01.287536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:01.287536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:01.287536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:01.287536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:01.287536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:01.287536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:01.287536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:01.287536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:13:01.287536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:13:01.287536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:13:01.287536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:13:01.288656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:13:01.288656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:13:01.288656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:13:01.288656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:13:01.288656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:01.288656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:01.288656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:01.288656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:01.288656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:01.288656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:01.288656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:01.288656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:01.288656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:01.288656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:01.288656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:01.288656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:01.290219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:01.290219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:01.290219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:01.290219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:01.290219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:13:01.290219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:13:01.290219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:13:01.290219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:13:01.290219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:13:01.290219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:13:01.290219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:13:01.290219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:01.292516 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 307/600] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Aug 19 19:13:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:01.298987 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b31cbf-2058-43d8-bbad-e8732e0f0b85 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:01.319589 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:01.328773 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a9835-2c9f-45ef-9dfb-d187b031c8ca None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:01.366115 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1b4c5-5705-42f4-8eeb-2bbd86e4aab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:01.366748 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1b4c5-5705-42f4-8eeb-2bbd86e4aab0 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:01.367026 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1b4c5-5705-42f4-8eeb-2bbd86e4aab0 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:01.367910 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1b4c5-5705-42f4-8eeb-2bbd86e4aab0 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:01.368648 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1b4c5-5705-42f4-8eeb-2bbd86e4aab0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:01.368953 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1b4c5-5705-42f4-8eeb-2bbd86e4aab0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:01.370339 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1b4c5-5705-42f4-8eeb-2bbd86e4aab0 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:01.384170 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 294/601] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:13:01.385080 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1b4c5-5705-42f4-8eeb-2bbd86e4aab0 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:01.426661 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b31cbf-2058-43d8-bbad-e8732e0f0b85 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:01.461963 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ecea6-03cc-4237-9e4f-cf4f3e38e665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:01.462597 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ecea6-03cc-4237-9e4f-cf4f3e38e665 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:01.462876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ecea6-03cc-4237-9e4f-cf4f3e38e665 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:01.463147 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ecea6-03cc-4237-9e4f-cf4f3e38e665 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:01.463807 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ecea6-03cc-4237-9e4f-cf4f3e38e665 None admin] RBAC: Adding query filter params (name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:01.464102 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ecea6-03cc-4237-9e4f-cf4f3e38e665 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:01.465463 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ecea6-03cc-4237-9e4f-cf4f3e38e665 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:01.473461 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 308/602] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Aug 19 19:13:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:13:01.474250 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ecea6-03cc-4237-9e4f-cf4f3e38e665 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:01.487864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1b4c5-5705-42f4-8eeb-2bbd86e4aab0 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:01.498561 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:01.521727 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bec52-a4bd-486c-ab2c-33ecbf7cec5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:01.522351 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bec52-a4bd-486c-ab2c-33ecbf7cec5d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:01.522655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bec52-a4bd-486c-ab2c-33ecbf7cec5d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:01.522925 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bec52-a4bd-486c-ab2c-33ecbf7cec5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:01.533660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bec52-a4bd-486c-ab2c-33ecbf7cec5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:13:01.538275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-ed2bec52-a4bd-486c-ab2c-33ecbf7cec5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:13:01.538275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:01.538275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:01.538275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:01.538275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:01.538275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:01.538275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:01.538275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:01.538275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:01.538275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:01.538275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:01.538275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:01.538275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:13:01.538275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:13:01.538275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:13:01.538275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:13:01.539603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:13:01.539603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:13:01.539603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:13:01.539603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:13:01.539603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:01.539603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:01.539603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:01.539603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:01.539603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:01.539603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:01.539603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:01.539603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:01.539603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:01.539603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:01.539603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:01.539603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:01.540615 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:01.540615 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:01.540615 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:01.540615 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:01.540615 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:13:01.540615 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:13:01.540615 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:13:01.540615 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:13:01.540615 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:13:01.540615 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:13:01.540615 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:13:01.540615 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:01.544455 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 295/603] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Aug 19 19:13:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:01.545299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bec52-a4bd-486c-ab2c-33ecbf7cec5d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:01.559906 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:01.578689 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ecea6-03cc-4237-9e4f-cf4f3e38e665 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:01.612450 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807201b-20cb-4788-bc8d-dd278dc10d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:01.613002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807201b-20cb-4788-bc8d-dd278dc10d3e None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:01.613279 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807201b-20cb-4788-bc8d-dd278dc10d3e None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:01.613550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807201b-20cb-4788-bc8d-dd278dc10d3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:01.620645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807201b-20cb-4788-bc8d-dd278dc10d3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:01.622080 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807201b-20cb-4788-bc8d-dd278dc10d3e None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:01.632992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-b807201b-20cb-4788-bc8d-dd278dc10d3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:13:01.632992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:01.632992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:01.632992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:01.632992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:01.632992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:01.632992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:01.632992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:01.632992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:01.632992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:01.632992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:01.632992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:01.632992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:13:01.632992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:13:01.632992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:13:01.633997 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:13:01.633997 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:01.633997 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:01.633997 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:01.633997 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:01.633997 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:01.633997 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:01.633997 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:01.633997 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:01.633997 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:01.633997 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:01.633997 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:01.633997 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:01.633997 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:01.633997 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:01.633997 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:01.633997 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:01.634960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:13:01.634960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:13:01.634960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:13:01.634960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:13:01.634960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:13:01.634960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:13:01.634960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:13:01.634960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:01.634960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 309/604] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:13:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:01.635430 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807201b-20cb-4788-bc8d-dd278dc10d3e None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:01.654375 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bec52-a4bd-486c-ab2c-33ecbf7cec5d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:01.689127 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a899ec6-5046-43d5-84a0-15ff06763715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:01.689750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a899ec6-5046-43d5-84a0-15ff06763715 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:01.690036 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a899ec6-5046-43d5-84a0-15ff06763715 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:01.690305 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a899ec6-5046-43d5-84a0-15ff06763715 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:01.701000 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a899ec6-5046-43d5-84a0-15ff06763715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:13:01.705636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-1a899ec6-5046-43d5-84a0-15ff06763715 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:13:01.705636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:01.705636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:01.705636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:01.705636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:01.705636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:01.705636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:01.705636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:01.705636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:01.705636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:01.705636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:01.705636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:01.705636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:13:01.705636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:13:01.705636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:13:01.705636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:13:01.706728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:13:01.706728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:13:01.706728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:13:01.706728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:13:01.706728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:01.706728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:01.706728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:01.706728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:01.706728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:01.706728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:01.706728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:01.706728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:01.706728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:01.706728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:01.706728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:01.706728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:01.707657 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:01.707657 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:01.707657 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:01.707657 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:01.707657 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:13:01.707657 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:13:01.707657 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:13:01.707657 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:13:01.707657 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:13:01.707657 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:13:01.707657 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:13:01.707657 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:01.707657 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 296/605] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Aug 19 19:13:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:01.708396 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a899ec6-5046-43d5-84a0-15ff06763715 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:01.719790 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:01.735343 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807201b-20cb-4788-bc8d-dd278dc10d3e None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:01.774083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c3eae-b29a-4a7d-ae01-c7d28e2a4a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:01.774739 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c3eae-b29a-4a7d-ae01-c7d28e2a4a55 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:01.775018 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c3eae-b29a-4a7d-ae01-c7d28e2a4a55 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:01.775301 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c3eae-b29a-4a7d-ae01-c7d28e2a4a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:01.779987 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:01.785672 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c3eae-b29a-4a7d-ae01-c7d28e2a4a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:01.787147 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c3eae-b29a-4a7d-ae01-c7d28e2a4a55 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:01.804069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-3d7c3eae-b29a-4a7d-ae01-c7d28e2a4a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:01.804069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:01.804069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:01.804069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:01.804069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:01.804069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:01.804069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:01.804069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:01.804069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:01.804069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:01.804069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:01.804069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:01.804069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:13:01.804069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:13:01.804069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:13:01.804069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:13:01.805391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:01.805391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:01.805391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:01.805391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:01.805391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:01.805391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:01.805391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:01.805391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:01.805391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:01.805391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:01.805391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:01.805391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:01.805391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:01.805391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:01.805391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:01.805391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:01.805391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:13:01.806479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:13:01.806479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:01.806479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:01.806479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 310/606] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:01.806479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c3eae-b29a-4a7d-ae01-c7d28e2a4a55 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:01.816143 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a899ec6-5046-43d5-84a0-15ff06763715 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:01.851333 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8731223-d928-45d1-9d87-63f86c4cde91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:01.852616 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8731223-d928-45d1-9d87-63f86c4cde91 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:01.852890 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8731223-d928-45d1-9d87-63f86c4cde91 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:01.853160 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8731223-d928-45d1-9d87-63f86c4cde91 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:01.853818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8731223-d928-45d1-9d87-63f86c4cde91 None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:01.854118 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8731223-d928-45d1-9d87-63f86c4cde91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:01.855571 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8731223-d928-45d1-9d87-63f86c4cde91 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:01.863580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 297/607] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Aug 19 19:13:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:01.864308 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8731223-d928-45d1-9d87-63f86c4cde91 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:01.908509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c3eae-b29a-4a7d-ae01-c7d28e2a4a55 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:01.942812 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a87d3b-e9c7-4c97-a5dd-67688ed6c406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:01.943461 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a87d3b-e9c7-4c97-a5dd-67688ed6c406 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:01.943743 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a87d3b-e9c7-4c97-a5dd-67688ed6c406 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:01.944009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a87d3b-e9c7-4c97-a5dd-67688ed6c406 None admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:01.944698 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a87d3b-e9c7-4c97-a5dd-67688ed6c406 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:01.944995 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a87d3b-e9c7-4c97-a5dd-67688ed6c406 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:01.946494 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a87d3b-e9c7-4c97-a5dd-67688ed6c406 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:01.949023 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:01.958671 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 311/608] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:13:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:01.959470 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a87d3b-e9c7-4c97-a5dd-67688ed6c406 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:01.963559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8731223-d928-45d1-9d87-63f86c4cde91 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:01.997766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b944430-cd3f-47b6-a928-26a8c0a1fbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:01.998390 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b944430-cd3f-47b6-a928-26a8c0a1fbad None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:01.998702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b944430-cd3f-47b6-a928-26a8c0a1fbad None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:01.998969 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b944430-cd3f-47b6-a928-26a8c0a1fbad None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:01.999626 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b944430-cd3f-47b6-a928-26a8c0a1fbad None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:01.999924 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b944430-cd3f-47b6-a928-26a8c0a1fbad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:02.001285 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b944430-cd3f-47b6-a928-26a8c0a1fbad None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:02.002648 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:02.010606 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 298/609] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Aug 19 19:13:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:02.011427 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b944430-cd3f-47b6-a928-26a8c0a1fbad None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:02.063124 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a87d3b-e9c7-4c97-a5dd-67688ed6c406 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:02.097099 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218ee72-1555-4163-b010-c71a36250b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:02.097705 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218ee72-1555-4163-b010-c71a36250b96 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:02.097968 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218ee72-1555-4163-b010-c71a36250b96 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:02.098240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218ee72-1555-4163-b010-c71a36250b96 None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:02.098893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218ee72-1555-4163-b010-c71a36250b96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:02.099189 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218ee72-1555-4163-b010-c71a36250b96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:02.100535 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218ee72-1555-4163-b010-c71a36250b96 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:02.112574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 312/610] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:02.114087 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b944430-cd3f-47b6-a928-26a8c0a1fbad None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:02.117204 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218ee72-1555-4163-b010-c71a36250b96 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:02.163515 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cd43b-bca6-46c0-936f-9380eb9e6278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:02.164164 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cd43b-bca6-46c0-936f-9380eb9e6278 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:02.164447 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cd43b-bca6-46c0-936f-9380eb9e6278 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:02.164712 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cd43b-bca6-46c0-936f-9380eb9e6278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:02.175023 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cd43b-bca6-46c0-936f-9380eb9e6278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:02.176002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:02.176470 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cd43b-bca6-46c0-936f-9380eb9e6278 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:02.191108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-f40cd43b-bca6-46c0-936f-9380eb9e6278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:02.191108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:02.191108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:02.191108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:02.191108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:02.191108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:02.191108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:02.191108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:02.191108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:02.191108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:02.191108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:02.191108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:02.191108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:13:02.191108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:13:02.191108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:13:02.191108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:13:02.192345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:02.192345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:02.192345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:02.192345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:02.192345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:02.192345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:02.192345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:02.192345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:02.192345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:02.192345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:02.192345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:02.192345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:02.192345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:02.192345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:02.192345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:02.192345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:02.192345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:13:02.193225 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:13:02.193225 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:02.193225 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:02.193225 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 299/611] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:02.193225 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cd43b-bca6-46c0-936f-9380eb9e6278 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:02.220799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218ee72-1555-4163-b010-c71a36250b96 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:02.244746 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:02.254811 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e44a5-2221-4222-967e-3e7c118a4ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:02.257285 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e44a5-2221-4222-967e-3e7c118a4ecc None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:02.257285 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e44a5-2221-4222-967e-3e7c118a4ecc None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:02.257285 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e44a5-2221-4222-967e-3e7c118a4ecc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:02.257285 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e44a5-2221-4222-967e-3e7c118a4ecc None admin] RBAC: Adding query filter params (role.id=1201f07f50a74488936b4eba2ba9a82c, scope.project.id=409a043500554125a93c4636db5a6812, user.id=54c899e786614c18b2bf4334ceb2f891) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:02.257285 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e44a5-2221-4222-967e-3e7c118a4ecc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:02.258942 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e44a5-2221-4222-967e-3e7c118a4ecc None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:02.264570 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 313/612] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:13:02 2022] GET /identity/v3/role_assignments?user.id=54c899e786614c18b2bf4334ceb2f891&scope.project.id=409a043500554125a93c4636db5a6812&role.id=1201f07f50a74488936b4eba2ba9a82c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:02.265354 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e44a5-2221-4222-967e-3e7c118a4ecc None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:02.301401 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cd43b-bca6-46c0-936f-9380eb9e6278 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:02.343823 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294f57c-5ce6-4f32-97c7-df9baab63bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:02.344484 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294f57c-5ce6-4f32-97c7-df9baab63bc3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:02.344765 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294f57c-5ce6-4f32-97c7-df9baab63bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:02.345048 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294f57c-5ce6-4f32-97c7-df9baab63bc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:02.358826 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294f57c-5ce6-4f32-97c7-df9baab63bc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:02.360420 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294f57c-5ce6-4f32-97c7-df9baab63bc3 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:02.378652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-1294f57c-5ce6-4f32-97c7-df9baab63bc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:02.378652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:02.378652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:02.378652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:02.378652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:02.378652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:02.378652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:02.378652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:02.378652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:02.378652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:02.378652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:02.378652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:02.378652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:13:02.378652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:13:02.378652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:13:02.378652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:13:02.379642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:02.379642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:02.379642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:02.379642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:02.379642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:02.379642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:02.379642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:02.379642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:02.379642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:02.379642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:02.379642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:02.379642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:02.379642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:02.379642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:02.379642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:02.379642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:02.379642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:13:02.380549 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:13:02.380549 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:02.380549 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:02.380549 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 300/613] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:02.380549 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294f57c-5ce6-4f32-97c7-df9baab63bc3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:02.401365 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e44a5-2221-4222-967e-3e7c118a4ecc None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:02.427496 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:02.443420 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc73f36-c1e9-4c7e-b705-1c7376803243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:02.444452 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc73f36-c1e9-4c7e-b705-1c7376803243 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:02.444743 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc73f36-c1e9-4c7e-b705-1c7376803243 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:02.445022 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc73f36-c1e9-4c7e-b705-1c7376803243 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:02.454024 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc73f36-c1e9-4c7e-b705-1c7376803243 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:02.455581 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc73f36-c1e9-4c7e-b705-1c7376803243 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:02.471802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-dbc73f36-c1e9-4c7e-b705-1c7376803243 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 19:13:02.471802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:02.471802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:02.471802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:02.471802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:02.471802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:02.471802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:02.471802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:02.471802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:02.471802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:02.471802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:02.471802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:02.471802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:13:02.471802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:13:02.471802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:13:02.471802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:13:02.472880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:02.472880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:02.472880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:13:02.472880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:13:02.472880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:13:02.472880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:13:02.472880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:02.472880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:02.472880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:02.472880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:02.472880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:02.472880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:02.472880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:02.472880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:02.472880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:02.472880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:02.472880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:02.472880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:02.473834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:02.473834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:02.473834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:13:02.473834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:13:02.473834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:13:02.473834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:13:02.473834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:13:02.473834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:13:02.473834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 19:13:02.473834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:02.473834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 314/614] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:13:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:02.474433 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc73f36-c1e9-4c7e-b705-1c7376803243 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:02.498185 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:02.502371 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294f57c-5ce6-4f32-97c7-df9baab63bc3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:02.545615 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd7a6b-ac4f-434b-91ae-631040c33e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:02.546232 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd7a6b-ac4f-434b-91ae-631040c33e82 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:02.546500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd7a6b-ac4f-434b-91ae-631040c33e82 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:02.546914 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd7a6b-ac4f-434b-91ae-631040c33e82 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:02.547486 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd7a6b-ac4f-434b-91ae-631040c33e82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:02.547791 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd7a6b-ac4f-434b-91ae-631040c33e82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:02.549381 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd7a6b-ac4f-434b-91ae-631040c33e82 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:02.564368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 301/615] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:02.565289 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd7a6b-ac4f-434b-91ae-631040c33e82 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:02.605239 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc73f36-c1e9-4c7e-b705-1c7376803243 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:02.640805 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc00c2-a0c0-4d85-987f-5f75fb172da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:02.641328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc00c2-a0c0-4d85-987f-5f75fb172da5 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:02.641608 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc00c2-a0c0-4d85-987f-5f75fb172da5 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:02.641878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc00c2-a0c0-4d85-987f-5f75fb172da5 None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:02.642512 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc00c2-a0c0-4d85-987f-5f75fb172da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:02.642841 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc00c2-a0c0-4d85-987f-5f75fb172da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:02.644208 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc00c2-a0c0-4d85-987f-5f75fb172da5 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:02.656609 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 315/616] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:02.657431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc00c2-a0c0-4d85-987f-5f75fb172da5 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:02.675173 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd7a6b-ac4f-434b-91ae-631040c33e82 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:02.703598 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:02.712713 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceb8b6-638b-4985-9a74-2c5c19520c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:02.713283 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceb8b6-638b-4985-9a74-2c5c19520c0c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:02.713537 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceb8b6-638b-4985-9a74-2c5c19520c0c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:02.713809 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceb8b6-638b-4985-9a74-2c5c19520c0c None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:02.721065 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bceb8b6-638b-4985-9a74-2c5c19520c0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:02.721065 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bceb8b6-638b-4985-9a74-2c5c19520c0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:02.721065 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bceb8b6-638b-4985-9a74-2c5c19520c0c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:02.735092 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 302/617] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Aug 19 19:13:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:02.735935 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceb8b6-638b-4985-9a74-2c5c19520c0c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:02.760358 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:02.769768 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc00c2-a0c0-4d85-987f-5f75fb172da5 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:02.804023 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a571e-db66-471a-a917-2fd933125f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:02.804762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a571e-db66-471a-a917-2fd933125f66 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:02.805054 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a571e-db66-471a-a917-2fd933125f66 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:02.805301 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a571e-db66-471a-a917-2fd933125f66 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:02.812791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a571e-db66-471a-a917-2fd933125f66 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:02.814253 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a571e-db66-471a-a917-2fd933125f66 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:02.828201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-ce0a571e-db66-471a-a917-2fd933125f66 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 19:13:02.828201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:02.828201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:02.828201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:02.828201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:02.828201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:02.828201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:02.828201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:02.828201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:02.828201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:02.828201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:02.828201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:02.828201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:13:02.828201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:13:02.828201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:13:02.828201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:13:02.829350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:02.829350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:02.829350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:13:02.829350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:13:02.829350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:13:02.829350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:13:02.829350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:02.829350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:02.829350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:02.829350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:02.829350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:02.829350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:02.829350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:02.829350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:02.829350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:02.829350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:02.829350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:02.829350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:02.830898 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:02.830898 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:02.830898 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:13:02.830898 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:13:02.830898 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:13:02.830898 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:13:02.830898 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:13:02.830898 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:13:02.830898 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 19:13:02.830898 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:02.830898 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 316/618] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:13:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:02.830898 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a571e-db66-471a-a917-2fd933125f66 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:02.850996 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceb8b6-638b-4985-9a74-2c5c19520c0c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:02.888080 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d9ec4-f025-4f27-9e3c-838e6ef2a3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:02.888712 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d9ec4-f025-4f27-9e3c-838e6ef2a3ff None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:02.888991 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d9ec4-f025-4f27-9e3c-838e6ef2a3ff None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:02.889263 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d9ec4-f025-4f27-9e3c-838e6ef2a3ff None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:02.896785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d9ec4-f025-4f27-9e3c-838e6ef2a3ff None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:02.898187 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d9ec4-f025-4f27-9e3c-838e6ef2a3ff None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:02.911151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-3c9d9ec4-f025-4f27-9e3c-838e6ef2a3ff None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 19:13:02.911151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:02.911151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:02.911151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:02.911151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:02.911151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:02.911151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:02.911151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:02.911151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:02.911151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:02.911151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:02.911151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:02.911151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:13:02.911151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:13:02.911151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:13:02.911151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:13:02.912104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:02.912104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:02.912104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:13:02.912104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:13:02.912104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:13:02.912104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:13:02.912104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:02.912104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:02.912104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:02.912104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:02.912104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:02.912104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:02.912104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:02.912104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:02.912104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:02.912104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:02.912104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:02.912104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:02.913032 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:02.913032 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:02.913032 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:13:02.913032 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:13:02.913032 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:13:02.913032 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:13:02.913032 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:13:02.913032 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:13:02.913032 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 19:13:02.913032 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:02.913032 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 303/619] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Aug 19 19:13:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:02.913032 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d9ec4-f025-4f27-9e3c-838e6ef2a3ff None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:02.949311 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:02.952372 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a571e-db66-471a-a917-2fd933125f66 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:02.990581 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecbc14-6586-4f60-843c-361acbaed96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:02.990581 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecbc14-6586-4f60-843c-361acbaed96b None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:02.990581 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecbc14-6586-4f60-843c-361acbaed96b None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:02.990581 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecbc14-6586-4f60-843c-361acbaed96b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:03.002307 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:03.027473 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d9ec4-f025-4f27-9e3c-838e6ef2a3ff None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:03.062609 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d2491-bb58-4dac-8120-83a2825aecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:03.063213 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d2491-bb58-4dac-8120-83a2825aecf0 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:03.063487 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d2491-bb58-4dac-8120-83a2825aecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:03.063590 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecbc14-6586-4f60-843c-361acbaed96b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:03.063750 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d2491-bb58-4dac-8120-83a2825aecf0 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:03.064470 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d2491-bb58-4dac-8120-83a2825aecf0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:03.064770 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d2491-bb58-4dac-8120-83a2825aecf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:03.065112 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecbc14-6586-4f60-843c-361acbaed96b None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:03.066163 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d2491-bb58-4dac-8120-83a2825aecf0 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:03.085626 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 304/620] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Aug 19 19:13:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:03.087017 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d2491-bb58-4dac-8120-83a2825aecf0 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:03.185279 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:03.188974 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 317/621] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:13:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:13:03.189826 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecbc14-6586-4f60-843c-361acbaed96b None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:03.205841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d2491-bb58-4dac-8120-83a2825aecf0 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:03.243160 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea446d81-06ad-4448-80e6-387239a4044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:03.244297 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea446d81-06ad-4448-80e6-387239a4044e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:03.244746 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea446d81-06ad-4448-80e6-387239a4044e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:03.245191 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea446d81-06ad-4448-80e6-387239a4044e None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:03.245920 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea446d81-06ad-4448-80e6-387239a4044e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:03.246225 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea446d81-06ad-4448-80e6-387239a4044e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:03.247771 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea446d81-06ad-4448-80e6-387239a4044e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:03.251690 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:03.272202 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 305/622] 10.222.0.61 () {56 vars in 1139 bytes} [Fri Aug 19 19:13:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:03.272202 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea446d81-06ad-4448-80e6-387239a4044e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:03.298411 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecbc14-6586-4f60-843c-361acbaed96b None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:03.332887 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e36ca5-e6a6-45a7-a5ec-6b7ccc59885a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:03.333578 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e36ca5-e6a6-45a7-a5ec-6b7ccc59885a None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:03.333860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e36ca5-e6a6-45a7-a5ec-6b7ccc59885a None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:03.334125 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e36ca5-e6a6-45a7-a5ec-6b7ccc59885a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:03.381281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea446d81-06ad-4448-80e6-387239a4044e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:03.404927 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:03.408016 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e36ca5-e6a6-45a7-a5ec-6b7ccc59885a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:03.409844 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e36ca5-e6a6-45a7-a5ec-6b7ccc59885a None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:03.419785 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c71d76-2a7a-44b8-b405-c786046829ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:03.420459 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c71d76-2a7a-44b8-b405-c786046829ba None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:03.423232 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c71d76-2a7a-44b8-b405-c786046829ba None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:03.423232 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c71d76-2a7a-44b8-b405-c786046829ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:03.431593 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c71d76-2a7a-44b8-b405-c786046829ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:03.433041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c71d76-2a7a-44b8-b405-c786046829ba None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:03.448794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-b0c71d76-2a7a-44b8-b405-c786046829ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:03.448794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:03.448794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:03.448794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:03.448794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:03.448794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:03.448794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:03.448794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:03.448794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:03.448794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:03.448794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:03.448794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:03.448794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:13:03.448794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:13:03.448794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:13:03.448794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:13:03.449786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:03.449786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:03.449786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:03.449786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:03.449786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:03.449786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:03.449786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:03.449786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:03.449786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:03.449786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:03.449786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:03.449786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:03.449786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:03.449786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:03.449786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:03.449786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:03.449786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:13:03.451145 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:13:03.451145 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:03.451145 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:03.454990 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 306/623] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:03.455519 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c71d76-2a7a-44b8-b405-c786046829ba None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:03.505851 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:03.526965 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 318/624] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:13:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:13:03.526965 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e36ca5-e6a6-45a7-a5ec-6b7ccc59885a None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:03.580232 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c71d76-2a7a-44b8-b405-c786046829ba None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:03.615721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7e0b6-0f3c-47b7-a76a-9c3d48cc9e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:03.616311 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7e0b6-0f3c-47b7-a76a-9c3d48cc9e7b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:03.616584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7e0b6-0f3c-47b7-a76a-9c3d48cc9e7b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:03.616855 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7e0b6-0f3c-47b7-a76a-9c3d48cc9e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:03.633346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:03.636386 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e36ca5-e6a6-45a7-a5ec-6b7ccc59885a None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:03.671299 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3eafd-922d-494f-9b1d-4fc880de0fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:03.671903 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3eafd-922d-494f-9b1d-4fc880de0fd2 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:03.672178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3eafd-922d-494f-9b1d-4fc880de0fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:03.672450 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3eafd-922d-494f-9b1d-4fc880de0fd2 None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:03.673088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3eafd-922d-494f-9b1d-4fc880de0fd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:03.673390 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3eafd-922d-494f-9b1d-4fc880de0fd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:03.674807 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3eafd-922d-494f-9b1d-4fc880de0fd2 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:03.686935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 319/625] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:03.687746 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3eafd-922d-494f-9b1d-4fc880de0fd2 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:03.699104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7e0b6-0f3c-47b7-a76a-9c3d48cc9e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:03.700723 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7e0b6-0f3c-47b7-a76a-9c3d48cc9e7b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:03.750187 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:03.786247 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3eafd-922d-494f-9b1d-4fc880de0fd2 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:03.812538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 307/626] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:13:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:13:03.812538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7e0b6-0f3c-47b7-a76a-9c3d48cc9e7b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:03.826513 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b54d92-4c18-4387-a05f-fb85e6940f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:03.827163 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b54d92-4c18-4387-a05f-fb85e6940f09 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:03.827439 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b54d92-4c18-4387-a05f-fb85e6940f09 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:03.827708 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b54d92-4c18-4387-a05f-fb85e6940f09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:03.838790 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b54d92-4c18-4387-a05f-fb85e6940f09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:03.840257 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b54d92-4c18-4387-a05f-fb85e6940f09 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:03.854567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-c2b54d92-4c18-4387-a05f-fb85e6940f09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:03.854567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:03.854567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:03.854567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:03.854567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:03.854567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:03.854567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:03.854567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:03.854567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:03.854567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:03.854567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:03.854567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:03.854567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:13:03.854567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:13:03.854567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:13:03.854567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:13:03.855533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:03.855533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:03.855533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:03.855533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:03.855533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:03.855533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:03.855533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:03.855533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:03.855533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:03.855533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:03.855533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:03.855533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:03.855533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:03.855533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:03.855533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:03.855533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:03.855533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:13:03.856457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:13:03.856457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:03.856457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:03.856457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 320/627] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:03.856457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b54d92-4c18-4387-a05f-fb85e6940f09 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:03.872159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:03.925773 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7e0b6-0f3c-47b7-a76a-9c3d48cc9e7b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:03.961493 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b54d92-4c18-4387-a05f-fb85e6940f09 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:03.965633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2236b-da4f-4f1c-8607-d446764b9174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:03.966268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2236b-da4f-4f1c-8607-d446764b9174 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:03.966575 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2236b-da4f-4f1c-8607-d446764b9174 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:03.966864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2236b-da4f-4f1c-8607-d446764b9174 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:03.973916 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2236b-da4f-4f1c-8607-d446764b9174 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:03.975506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2236b-da4f-4f1c-8607-d446764b9174 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:03.988268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-e4e2236b-da4f-4f1c-8607-d446764b9174 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:13:03.988268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:03.988268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:03.988268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:03.988268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:03.988268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:03.988268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:03.988268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:03.988268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:03.988268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:03.988268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:03.988268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:03.988268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:13:03.988268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:13:03.988268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:13:03.989201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:13:03.989201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:03.989201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:03.989201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:03.989201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:03.989201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:03.989201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:03.989201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:03.989201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:03.989201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:03.989201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:03.989201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:03.989201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:03.989201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:03.989201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:03.989201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:03.989201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:03.990086 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:13:03.990086 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:13:03.990086 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:13:03.990086 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:13:03.990086 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:13:03.990086 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:13:03.990086 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:13:03.990086 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:03.990086 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 308/628] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:13:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:03.990596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2236b-da4f-4f1c-8607-d446764b9174 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:04.000129 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:04.002489 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623306ba-b210-41fa-b7b7-6a956bdbee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:04.003160 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623306ba-b210-41fa-b7b7-6a956bdbee67 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:04.003443 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623306ba-b210-41fa-b7b7-6a956bdbee67 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:04.003718 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623306ba-b210-41fa-b7b7-6a956bdbee67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:04.014827 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623306ba-b210-41fa-b7b7-6a956bdbee67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:04.016307 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623306ba-b210-41fa-b7b7-6a956bdbee67 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:04.031066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-623306ba-b210-41fa-b7b7-6a956bdbee67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:04.031066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:04.031066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:04.031066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:04.031066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:04.031066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:04.031066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:04.031066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:04.031066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:04.031066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:04.031066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:04.031066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:04.031066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:13:04.031066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:13:04.031066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:13:04.031066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:13:04.032120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:04.032120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:04.032120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:04.032120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:04.032120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:04.032120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:04.032120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:04.032120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:04.032120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:04.032120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:04.032120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:04.032120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:04.032120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:04.032120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:04.032120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:04.032120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:04.032120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:13:04.037631 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:13:04.037631 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:04.037631 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:04.037631 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 321/629] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:04.037631 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623306ba-b210-41fa-b7b7-6a956bdbee67 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:04.100737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:04.106329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2236b-da4f-4f1c-8607-d446764b9174 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:04.141106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7921e8-909e-40e6-a3d3-b869322e1c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:04.141716 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7921e8-909e-40e6-a3d3-b869322e1c89 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:04.141995 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7921e8-909e-40e6-a3d3-b869322e1c89 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:04.142267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7921e8-909e-40e6-a3d3-b869322e1c89 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:04.142947 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7921e8-909e-40e6-a3d3-b869322e1c89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:04.143249 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7921e8-909e-40e6-a3d3-b869322e1c89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:04.144220 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623306ba-b210-41fa-b7b7-6a956bdbee67 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:04.144618 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7921e8-909e-40e6-a3d3-b869322e1c89 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:04.161887 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 309/630] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:04.161887 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7921e8-909e-40e6-a3d3-b869322e1c89 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:04.186737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd77e14-bfb0-458b-a6d8-6467f4dbead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:04.187588 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd77e14-bfb0-458b-a6d8-6467f4dbead3 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:04.188092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd77e14-bfb0-458b-a6d8-6467f4dbead3 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:04.188633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd77e14-bfb0-458b-a6d8-6467f4dbead3 None admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:04.189327 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd77e14-bfb0-458b-a6d8-6467f4dbead3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:04.189634 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd77e14-bfb0-458b-a6d8-6467f4dbead3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:04.191084 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd77e14-bfb0-458b-a6d8-6467f4dbead3 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:04.205486 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 322/631] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:13:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:04.206416 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd77e14-bfb0-458b-a6d8-6467f4dbead3 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:04.230090 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:04.266905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7921e8-909e-40e6-a3d3-b869322e1c89 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:04.302730 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3ef66-ec65-4be2-a74c-19d43c25f50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:04.303330 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3ef66-ec65-4be2-a74c-19d43c25f50d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:04.303606 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3ef66-ec65-4be2-a74c-19d43c25f50d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:04.303882 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3ef66-ec65-4be2-a74c-19d43c25f50d None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:04.304530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3ef66-ec65-4be2-a74c-19d43c25f50d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:04.305402 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3ef66-ec65-4be2-a74c-19d43c25f50d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:04.306806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3ef66-ec65-4be2-a74c-19d43c25f50d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:04.317703 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd77e14-bfb0-458b-a6d8-6467f4dbead3 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:04.318378 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 310/632] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:04.318987 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3ef66-ec65-4be2-a74c-19d43c25f50d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:04.347545 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:04.360411 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b28dc-83c6-4537-a962-0995048e89da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:04.361044 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b28dc-83c6-4537-a962-0995048e89da None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:04.361325 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b28dc-83c6-4537-a962-0995048e89da None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:04.361601 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b28dc-83c6-4537-a962-0995048e89da None admin] PATH_INFO: `/v3/projects/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:04.369740 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b28dc-83c6-4537-a962-0995048e89da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:04.371342 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b28dc-83c6-4537-a962-0995048e89da None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:04.385292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-b75b28dc-83c6-4537-a962-0995048e89da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:13:04.385292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:04.385292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:04.385292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:04.385292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:04.385292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:04.385292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:04.385292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:04.385292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:04.385292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:04.385292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:04.385292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:04.385292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:13:04.385292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:13:04.385292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:13:04.386223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:13:04.386223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:04.386223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:04.386223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:04.386223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:04.386223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:04.386223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:04.386223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:04.386223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:04.386223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:04.386223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:04.386223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:04.386223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:04.386223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:04.386223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:04.386223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:04.386223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:04.387509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:13:04.387509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:13:04.387509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:13:04.387509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:13:04.387509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:13:04.387509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:13:04.387509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:13:04.387509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:04.387509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 323/633] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:13:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:04.387509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b28dc-83c6-4537-a962-0995048e89da None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:04.440865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3ef66-ec65-4be2-a74c-19d43c25f50d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:04.469004 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:04.479742 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d38bb-3cf2-43d1-aa86-ff4a5a5f1442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:04.483723 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d38bb-3cf2-43d1-aa86-ff4a5a5f1442 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:04.483723 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d38bb-3cf2-43d1-aa86-ff4a5a5f1442 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:04.483723 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d38bb-3cf2-43d1-aa86-ff4a5a5f1442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:04.483723 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d38bb-3cf2-43d1-aa86-ff4a5a5f1442 None admin] RBAC: Adding query filter params (role.id=1201f07f50a74488936b4eba2ba9a82c, scope.project.id=409a043500554125a93c4636db5a6812, user.id=1bca70a332304359bcc9d873ebbe14de) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:04.483723 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d38bb-3cf2-43d1-aa86-ff4a5a5f1442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:04.483723 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d38bb-3cf2-43d1-aa86-ff4a5a5f1442 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:04.489568 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 311/634] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:13:04 2022] GET /identity/v3/role_assignments?user.id=1bca70a332304359bcc9d873ebbe14de&scope.project.id=409a043500554125a93c4636db5a6812&role.id=1201f07f50a74488936b4eba2ba9a82c => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:04.490289 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d38bb-3cf2-43d1-aa86-ff4a5a5f1442 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:04.506340 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b28dc-83c6-4537-a962-0995048e89da None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:04.571214 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7e853-8781-43f1-b6ba-b8b1c1a3ef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:04.571214 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7e853-8781-43f1-b6ba-b8b1c1a3ef1b None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:04.571214 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7e853-8781-43f1-b6ba-b8b1c1a3ef1b None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:04.571214 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7e853-8781-43f1-b6ba-b8b1c1a3ef1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:04.582750 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7e853-8781-43f1-b6ba-b8b1c1a3ef1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:04.586665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7e853-8781-43f1-b6ba-b8b1c1a3ef1b None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:04.602639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-d6c7e853-8781-43f1-b6ba-b8b1c1a3ef1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:13:04.602639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:04.602639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:04.602639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:04.602639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:04.602639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:04.602639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:04.602639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:04.602639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:04.602639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:04.602639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:04.602639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:04.602639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:13:04.602639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:13:04.602639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:13:04.603612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:13:04.603612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:04.603612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:04.603612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:04.603612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:04.603612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:04.603612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:04.603612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:04.603612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:04.603612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:04.603612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:04.603612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:04.603612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:04.603612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:04.603612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:04.603612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:04.603612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:04.604533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:13:04.604533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:13:04.604533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:13:04.604533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:13:04.604533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:13:04.604533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:13:04.604533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:13:04.604533 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:04.608559 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 324/635] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:13:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:04.610007 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e3795-5809-48da-820f-6ea326d13069 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:04.610295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e3795-5809-48da-820f-6ea326d13069 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:04.610588 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e3795-5809-48da-820f-6ea326d13069 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:04.616007 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 325/636] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:04.616007 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e3795-5809-48da-820f-6ea326d13069 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:04.654367 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d38bb-3cf2-43d1-aa86-ff4a5a5f1442 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:04.670834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:04.696927 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49cb2f-4689-4455-9012-efa0a99c75e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:04.698032 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49cb2f-4689-4455-9012-efa0a99c75e2 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:04.698308 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49cb2f-4689-4455-9012-efa0a99c75e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:04.698632 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49cb2f-4689-4455-9012-efa0a99c75e2 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:04.699331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49cb2f-4689-4455-9012-efa0a99c75e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:04.700044 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49cb2f-4689-4455-9012-efa0a99c75e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:04.702222 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49cb2f-4689-4455-9012-efa0a99c75e2 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:04.715911 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 312/637] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:13:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:04.716966 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bce1e-f6a7-4ed8-ade1-1ff58f3ad288 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:04.717245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bce1e-f6a7-4ed8-ade1-1ff58f3ad288 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:04.717519 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bce1e-f6a7-4ed8-ade1-1ff58f3ad288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:04.738375 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-5a1bce1e-f6a7-4ed8-ade1-1ff58f3ad288 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:04.739526 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5a1bce1e-f6a7-4ed8-ade1-1ff58f3ad288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:04.740558 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e3795-5809-48da-820f-6ea326d13069 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:04.781803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30320e-cad8-49e7-832a-9e66ee09fe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:04.782761 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30320e-cad8-49e7-832a-9e66ee09fe1d None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:04.783250 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30320e-cad8-49e7-832a-9e66ee09fe1d None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:04.783699 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30320e-cad8-49e7-832a-9e66ee09fe1d None admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:04.784569 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30320e-cad8-49e7-832a-9e66ee09fe1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:04.785059 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30320e-cad8-49e7-832a-9e66ee09fe1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:04.786488 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30320e-cad8-49e7-832a-9e66ee09fe1d None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:04.792251 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:04.800339 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 326/638] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:13:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:04.805311 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30320e-cad8-49e7-832a-9e66ee09fe1d None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:04.822676 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 313/639] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:13:04.823643 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bce1e-f6a7-4ed8-ade1-1ff58f3ad288 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:04.931498 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30320e-cad8-49e7-832a-9e66ee09fe1d None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:04.933798 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:04.952699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bce1e-f6a7-4ed8-ade1-1ff58f3ad288 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:04.974195 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb988d-d919-454e-ad1e-4aeb46028aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:04.974880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb988d-d919-454e-ad1e-4aeb46028aa0 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:04.975125 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb988d-d919-454e-ad1e-4aeb46028aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:04.975395 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb988d-d919-454e-ad1e-4aeb46028aa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:04.976124 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb988d-d919-454e-ad1e-4aeb46028aa0 None admin] RBAC: Adding query filter params (role.id=1201f07f50a74488936b4eba2ba9a82c, scope.project.id=409a043500554125a93c4636db5a6812, user.id=23bbd8bfe6924ea2a6fd35513f830cb4) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:04.977414 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb988d-d919-454e-ad1e-4aeb46028aa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:04.978889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb988d-d919-454e-ad1e-4aeb46028aa0 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:04.990623 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 327/640] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:13:04 2022] GET /identity/v3/role_assignments?user.id=23bbd8bfe6924ea2a6fd35513f830cb4&scope.project.id=409a043500554125a93c4636db5a6812&role.id=1201f07f50a74488936b4eba2ba9a82c => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:05.001402 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026101a-abee-48df-856a-351c72c12fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:05.002082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026101a-abee-48df-856a-351c72c12fda None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:05.002358 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026101a-abee-48df-856a-351c72c12fda None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:05.002677 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026101a-abee-48df-856a-351c72c12fda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:05.003416 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026101a-abee-48df-856a-351c72c12fda None admin] RBAC: Adding query filter params (role.id=1201f07f50a74488936b4eba2ba9a82c, scope.project.id=409a043500554125a93c4636db5a6812, user.id=84bd0bde9a164516a26768a3eb44fdec) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:05.003724 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026101a-abee-48df-856a-351c72c12fda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:05.005191 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026101a-abee-48df-856a-351c72c12fda None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:05.012968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 314/641] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:13:04 2022] GET /identity/v3/role_assignments?user.id=84bd0bde9a164516a26768a3eb44fdec&scope.project.id=409a043500554125a93c4636db5a6812&role.id=1201f07f50a74488936b4eba2ba9a82c => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:05.152564 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb988d-d919-454e-ad1e-4aeb46028aa0 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:05.272328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb988d-d919-454e-ad1e-4aeb46028aa0 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:05.309456 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d21681-1f54-4aeb-a198-c1fcdc506e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:05.310084 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d21681-1f54-4aeb-a198-c1fcdc506e71 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:05.310363 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d21681-1f54-4aeb-a198-c1fcdc506e71 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:05.310725 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d21681-1f54-4aeb-a198-c1fcdc506e71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:05.322220 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d21681-1f54-4aeb-a198-c1fcdc506e71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:13:05.326934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-11d21681-1f54-4aeb-a198-c1fcdc506e71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:13:05.326934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:05.326934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:05.326934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:05.326934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:05.326934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:05.326934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:05.326934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:05.326934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:05.326934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:05.326934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:05.326934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:05.326934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:13:05.326934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:13:05.326934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:13:05.326934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:13:05.327935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:13:05.327935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:13:05.327935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:13:05.327935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:13:05.327935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:05.327935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:05.327935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:05.327935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:05.327935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:05.327935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:05.327935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:05.327935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:05.327935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:05.327935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:05.327935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:05.327935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:05.328876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:05.328876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:05.328876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:05.328876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:05.328876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:13:05.328876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:13:05.328876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:13:05.328876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:13:05.328876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:13:05.328876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:13:05.328876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:13:05.328876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:05.328876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 328/642] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Aug 19 19:13:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:05.333799 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026101a-abee-48df-856a-351c72c12fda None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:05.387589 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:05.447583 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026101a-abee-48df-856a-351c72c12fda None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:05.483434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b0698-28f7-4952-ae07-37d1c4a4b7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:05.484205 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b0698-28f7-4952-ae07-37d1c4a4b7ff None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:05.484578 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b0698-28f7-4952-ae07-37d1c4a4b7ff None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:05.484949 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b0698-28f7-4952-ae07-37d1c4a4b7ff None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:05.485776 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b0698-28f7-4952-ae07-37d1c4a4b7ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:05.486196 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b0698-28f7-4952-ae07-37d1c4a4b7ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:05.487741 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b0698-28f7-4952-ae07-37d1c4a4b7ff None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:05.497544 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 315/643] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:13:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:05.503010 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d21681-1f54-4aeb-a198-c1fcdc506e71 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:05.536200 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:05.621677 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d21681-1f54-4aeb-a198-c1fcdc506e71 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:05.657693 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47f85a-d515-44b9-850a-065f95adcf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:05.658588 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47f85a-d515-44b9-850a-065f95adcf75 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:05.658725 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47f85a-d515-44b9-850a-065f95adcf75 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:05.658964 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47f85a-d515-44b9-850a-065f95adcf75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:05.674737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47f85a-d515-44b9-850a-065f95adcf75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:05.676360 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47f85a-d515-44b9-850a-065f95adcf75 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:05.692682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-7c47f85a-d515-44b9-850a-065f95adcf75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:05.692682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:05.692682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:05.692682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:05.692682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:05.692682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:05.692682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:05.692682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:05.692682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:05.692682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:05.692682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:05.692682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:05.692682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:13:05.692682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:13:05.692682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:13:05.692682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:13:05.693850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:05.693850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:05.693850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:05.693850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:05.693850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:05.693850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:05.693850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:05.693850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:05.693850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:05.693850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:05.693850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:05.693850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:05.693850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:05.693850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:05.693850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:05.693850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:05.693850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:13:05.694975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:13:05.694975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:05.694975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:05.698550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 329/644] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:05.703407 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b0698-28f7-4952-ae07-37d1c4a4b7ff None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:05.820789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b0698-28f7-4952-ae07-37d1c4a4b7ff None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:05.829947 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:05.855683 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19f6f4-7d3a-4cb6-99db-c646ed98f9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:05.856309 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19f6f4-7d3a-4cb6-99db-c646ed98f9f5 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:05.856583 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19f6f4-7d3a-4cb6-99db-c646ed98f9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:05.856849 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19f6f4-7d3a-4cb6-99db-c646ed98f9f5 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:05.857493 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19f6f4-7d3a-4cb6-99db-c646ed98f9f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:05.857791 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19f6f4-7d3a-4cb6-99db-c646ed98f9f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:05.859206 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19f6f4-7d3a-4cb6-99db-c646ed98f9f5 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:05.871795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 316/645] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:05.879592 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47f85a-d515-44b9-850a-065f95adcf75 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:05.962105 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:05.980980 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47f85a-d515-44b9-850a-065f95adcf75 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:06.014851 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ee69d-d166-41e1-8ed2-64cb58715ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:06.015469 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ee69d-d166-41e1-8ed2-64cb58715ad6 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:06.015743 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ee69d-d166-41e1-8ed2-64cb58715ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:06.016009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ee69d-d166-41e1-8ed2-64cb58715ad6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:06.023985 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ee69d-d166-41e1-8ed2-64cb58715ad6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:06.025415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ee69d-d166-41e1-8ed2-64cb58715ad6 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:06.036240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-539ee69d-d166-41e1-8ed2-64cb58715ad6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:13:06.036240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:06.036240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:06.036240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:06.036240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:06.036240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:06.036240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:06.036240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:06.036240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:06.036240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:06.036240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:06.036240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:06.036240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:13:06.036240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:13:06.036240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:13:06.036240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:13:06.037157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:06.037157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:06.037157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:13:06.037157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:13:06.037157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:13:06.037157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:13:06.037157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:06.037157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:06.037157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:06.037157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:06.037157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:06.037157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:06.037157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:06.037157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:06.037157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:06.037157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:06.037157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:06.037157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:06.038097 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:06.038097 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:06.038097 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:13:06.038097 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:13:06.038097 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:13:06.038097 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:13:06.038097 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:13:06.038097 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:13:06.038097 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:13:06.038097 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:06.038097 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 330/646] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Aug 19 19:13:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:06.043177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19f6f4-7d3a-4cb6-99db-c646ed98f9f5 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:06.149727 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19f6f4-7d3a-4cb6-99db-c646ed98f9f5 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:06.186119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ccfbf-9954-485f-a42f-91a618b8d701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:06.187119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ccfbf-9954-485f-a42f-91a618b8d701 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:06.187601 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ccfbf-9954-485f-a42f-91a618b8d701 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:06.188089 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ccfbf-9954-485f-a42f-91a618b8d701 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:06.189079 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ccfbf-9954-485f-a42f-91a618b8d701 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:06.189611 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ccfbf-9954-485f-a42f-91a618b8d701 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:06.191541 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ccfbf-9954-485f-a42f-91a618b8d701 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:06.211536 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 317/647] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Aug 19 19:13:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:06.219550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ee69d-d166-41e1-8ed2-64cb58715ad6 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:06.332982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ee69d-d166-41e1-8ed2-64cb58715ad6 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:06.369920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c69871-781c-4969-9165-5eae39cfe0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:06.370541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c69871-781c-4969-9165-5eae39cfe0ab None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:06.370825 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c69871-781c-4969-9165-5eae39cfe0ab None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:06.371095 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c69871-781c-4969-9165-5eae39cfe0ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:06.381880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:06.443839 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c69871-781c-4969-9165-5eae39cfe0ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:06.445574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c69871-781c-4969-9165-5eae39cfe0ab None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:06.548292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 331/648] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 19:13:06.553449 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ccfbf-9954-485f-a42f-91a618b8d701 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:06.582810 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:06.671295 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ccfbf-9954-485f-a42f-91a618b8d701 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:06.709282 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc4ee7-1976-49dd-a1df-76e25e4e7d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:06.709841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc4ee7-1976-49dd-a1df-76e25e4e7d4f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:06.710119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc4ee7-1976-49dd-a1df-76e25e4e7d4f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:06.710391 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc4ee7-1976-49dd-a1df-76e25e4e7d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:06.722830 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc4ee7-1976-49dd-a1df-76e25e4e7d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:06.724295 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc4ee7-1976-49dd-a1df-76e25e4e7d4f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:06.740538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-2ccc4ee7-1976-49dd-a1df-76e25e4e7d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:06.740538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:06.740538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:06.740538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:06.740538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:06.740538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:06.740538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:06.740538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:06.740538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:06.740538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:06.740538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:06.740538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:06.740538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:13:06.740538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:13:06.740538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:13:06.740538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:13:06.743650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:06.743650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:06.743650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:06.743650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:06.743650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:06.743650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:06.743650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:06.743650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:06.743650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:06.743650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:06.743650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:06.743650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:06.743650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:06.743650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:06.743650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:06.743650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:06.743650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:13:06.744737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:13:06.744737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:06.744737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:06.744737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 318/649] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:06.748852 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c69871-781c-4969-9165-5eae39cfe0ab None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:06.796618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:06.860948 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c69871-781c-4969-9165-5eae39cfe0ab None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:06.898820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9eccf-e2ed-419e-8c6f-1ad2a13f4290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:06.899546 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9eccf-e2ed-419e-8c6f-1ad2a13f4290 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:06.899740 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9eccf-e2ed-419e-8c6f-1ad2a13f4290 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:06.899981 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9eccf-e2ed-419e-8c6f-1ad2a13f4290 None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:06.900689 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9eccf-e2ed-419e-8c6f-1ad2a13f4290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:06.900993 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9eccf-e2ed-419e-8c6f-1ad2a13f4290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:06.902384 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9eccf-e2ed-419e-8c6f-1ad2a13f4290 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:06.915186 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 332/650] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:06.920538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc4ee7-1976-49dd-a1df-76e25e4e7d4f None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:06.973772 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efea181-14ff-47f3-8d32-35c959735fbd None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:06.974421 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efea181-14ff-47f3-8d32-35c959735fbd None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:06.974947 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efea181-14ff-47f3-8d32-35c959735fbd None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:06.977429 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 333/651] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:13:06.987379 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31533e1-b334-47a6-9f15-7ec34ddb93f0 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:06.988419 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31533e1-b334-47a6-9f15-7ec34ddb93f0 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:06.988970 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31533e1-b334-47a6-9f15-7ec34ddb93f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:07.010687 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-b31533e1-b334-47a6-9f15-7ec34ddb93f0 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:07.012250 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-b31533e1-b334-47a6-9f15-7ec34ddb93f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:07.016751 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:07.048266 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc4ee7-1976-49dd-a1df-76e25e4e7d4f None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:07.090458 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6015f8-6123-4d41-9a48-a2e106ca1fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:07.091562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6015f8-6123-4d41-9a48-a2e106ca1fde None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:07.092043 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6015f8-6123-4d41-9a48-a2e106ca1fde None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:07.092515 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6015f8-6123-4d41-9a48-a2e106ca1fde None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:07.099699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6015f8-6123-4d41-9a48-a2e106ca1fde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:07.101531 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6015f8-6123-4d41-9a48-a2e106ca1fde None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:07.103256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 334/652] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 19:13:07.117883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-dd6015f8-6123-4d41-9a48-a2e106ca1fde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:13:07.117883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:07.117883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:07.117883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:07.117883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:07.117883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:07.117883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:07.117883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:07.117883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:07.117883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:07.117883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:07.117883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:07.117883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:13:07.117883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:13:07.117883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:13:07.119008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:13:07.119008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:07.119008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:07.119008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:07.119008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:07.119008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:07.119008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:07.119008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:07.119008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:07.119008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:07.119008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:07.119008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:07.119008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:07.119008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:07.119008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:07.119008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:07.119008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:07.120133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:13:07.120133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:13:07.120133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:13:07.120133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:13:07.120133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:13:07.120133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:13:07.120133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:13:07.120133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:07.122152 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 319/653] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:13:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:07.131680 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31533e1-b334-47a6-9f15-7ec34ddb93f0 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:07.165566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:07.243865 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31533e1-b334-47a6-9f15-7ec34ddb93f0 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:07.280935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d832e73-44f0-4f46-9eaa-07baa266aea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:07.281826 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d832e73-44f0-4f46-9eaa-07baa266aea6 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:07.282254 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d832e73-44f0-4f46-9eaa-07baa266aea6 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:07.282714 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d832e73-44f0-4f46-9eaa-07baa266aea6 None admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:07.283550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d832e73-44f0-4f46-9eaa-07baa266aea6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:07.284002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d832e73-44f0-4f46-9eaa-07baa266aea6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:07.285580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d832e73-44f0-4f46-9eaa-07baa266aea6 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:07.299197 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 335/654] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:13:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:07.308350 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6015f8-6123-4d41-9a48-a2e106ca1fde None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:07.424618 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6015f8-6123-4d41-9a48-a2e106ca1fde None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:07.461905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba2bdf-08a8-40dd-968f-e4fb988721f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:07.462825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba2bdf-08a8-40dd-968f-e4fb988721f4 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:07.463253 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba2bdf-08a8-40dd-968f-e4fb988721f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:07.463673 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba2bdf-08a8-40dd-968f-e4fb988721f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:07.464542 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba2bdf-08a8-40dd-968f-e4fb988721f4 None admin] RBAC: Adding query filter params (role.id=8fdfbc4aaf68468f89a5ae3450b8488d, scope.project.id=409a043500554125a93c4636db5a6812, user.id=54c899e786614c18b2bf4334ceb2f891) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:07.465015 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba2bdf-08a8-40dd-968f-e4fb988721f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:07.466637 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba2bdf-08a8-40dd-968f-e4fb988721f4 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:07.469843 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:07.473633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 320/655] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:13:07 2022] GET /identity/v3/role_assignments?user.id=54c899e786614c18b2bf4334ceb2f891&scope.project.id=409a043500554125a93c4636db5a6812&role.id=8fdfbc4aaf68468f89a5ae3450b8488d => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:07.479901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5223049-d08b-4092-8e3f-7cb213b7d287 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:07.479901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5223049-d08b-4092-8e3f-7cb213b7d287 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:07.479901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5223049-d08b-4092-8e3f-7cb213b7d287 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:07.479901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 336/656] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:07.486219 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca682b0d-1e9e-4248-8359-20f434595bca None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:07.486816 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca682b0d-1e9e-4248-8359-20f434595bca None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:07.494633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca682b0d-1e9e-4248-8359-20f434595bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:07.494815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5223049-d08b-4092-8e3f-7cb213b7d287 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:07.506673 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ca682b0d-1e9e-4248-8359-20f434595bca None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:07.508450 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ca682b0d-1e9e-4248-8359-20f434595bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:07.599673 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:07.600523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 321/657] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:13:07.602597 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b0c4a-92f4-4b33-9d9f-cfe869ca19c0 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:07.602888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b0c4a-92f4-4b33-9d9f-cfe869ca19c0 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:07.603160 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b0c4a-92f4-4b33-9d9f-cfe869ca19c0 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:07.604534 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 322/658] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:07.610459 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43d57e-c312-4095-9746-404b9bd84702 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:07.614812 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43d57e-c312-4095-9746-404b9bd84702 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:07.614812 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43d57e-c312-4095-9746-404b9bd84702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:07.624172 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5223049-d08b-4092-8e3f-7cb213b7d287 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:07.636265 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-cf43d57e-c312-4095-9746-404b9bd84702 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:07.637847 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-cf43d57e-c312-4095-9746-404b9bd84702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:07.667341 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff16b24-4c73-493a-96e2-a36e72875cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:07.668074 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff16b24-4c73-493a-96e2-a36e72875cd0 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:07.668425 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff16b24-4c73-493a-96e2-a36e72875cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:07.668766 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff16b24-4c73-493a-96e2-a36e72875cd0 None admin] PATH_INFO: `/v3/services/image` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:07.670229 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff16b24-4c73-493a-96e2-a36e72875cd0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:07.671643 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff16b24-4c73-493a-96e2-a36e72875cd0 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:07.683293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-9ff16b24-4c73-493a-96e2-a36e72875cd0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 19:13:07.683293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:07.683293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:13:07.683293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:13:07.683293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:13:07.683293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:13:07.683293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:13:07.683293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:07.683293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 19:13:07.683293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:07.683293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:07.683293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:07.683293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:07.683293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:07.683293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:07.683293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:07.683293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:07.684350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:07.684350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:07.684350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:07.684350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:07.684350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:07.684350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:07.684350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:13:07.684350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:13:07.684350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:13:07.684350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:13:07.684350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:07.684350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:07.684350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:07.684350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:07.684350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:07.684350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:07.685191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:07.685191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:07.685191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:07.685191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:07.685191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:07.685191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:07.685191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:07.685191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:07.685191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:07.685191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:07.685191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:13:07.685191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:07.685191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 19:13:07.685191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:07.689334 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 337/659] 10.222.0.61 () {56 vars in 1105 bytes} [Fri Aug 19 19:13:07 2022] GET /identity/v3/services/image => generated 86 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:13:07.690637 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff16b24-4c73-493a-96e2-a36e72875cd0 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:07.731000 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 323/660] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:13:07.796815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff16b24-4c73-493a-96e2-a36e72875cd0 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:07.831403 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227e8bb-b42e-4e98-bac5-92e59f74e4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:07.832154 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227e8bb-b42e-4e98-bac5-92e59f74e4b1 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:07.832438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227e8bb-b42e-4e98-bac5-92e59f74e4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:07.832714 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227e8bb-b42e-4e98-bac5-92e59f74e4b1 None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:07.833347 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227e8bb-b42e-4e98-bac5-92e59f74e4b1 None admin] RBAC: Adding query filter params (name=image) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:07.833651 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227e8bb-b42e-4e98-bac5-92e59f74e4b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:07.835121 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227e8bb-b42e-4e98-bac5-92e59f74e4b1 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:07.845070 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 338/661] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:07.847642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43d57e-c312-4095-9746-404b9bd84702 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:07.911089 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:07.953553 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227e8bb-b42e-4e98-bac5-92e59f74e4b1 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:07.954851 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43d57e-c312-4095-9746-404b9bd84702 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:07.978617 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:07.995689 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0eaa29-ac03-4825-bd68-254bd805a1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:07.997982 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0eaa29-ac03-4825-bd68-254bd805a1f6 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:07.997982 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0eaa29-ac03-4825-bd68-254bd805a1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:07.997982 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0eaa29-ac03-4825-bd68-254bd805a1f6 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:07.997982 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0eaa29-ac03-4825-bd68-254bd805a1f6 None admin] RBAC: Adding query filter params (type=image) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:07.998247 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0eaa29-ac03-4825-bd68-254bd805a1f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:07.999574 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0eaa29-ac03-4825-bd68-254bd805a1f6 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:08.006051 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 324/662] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:08.073856 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227e8bb-b42e-4e98-bac5-92e59f74e4b1 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:08.106239 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0eaa29-ac03-4825-bd68-254bd805a1f6 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:08.113507 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c415a8-c44d-4736-8ce2-9e47819fb765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:08.114152 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c415a8-c44d-4736-8ce2-9e47819fb765 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:08.114442 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c415a8-c44d-4736-8ce2-9e47819fb765 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:08.114720 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c415a8-c44d-4736-8ce2-9e47819fb765 None admin] PATH_INFO: `/v3/services/network` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:08.115310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c415a8-c44d-4736-8ce2-9e47819fb765 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:08.116731 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c415a8-c44d-4736-8ce2-9e47819fb765 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:08.126752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-54c415a8-c44d-4736-8ce2-9e47819fb765 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 19:13:08.126752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:08.126752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:13:08.126752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:13:08.126752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:13:08.126752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:13:08.126752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:13:08.126752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:08.126752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 19:13:08.126752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:08.126752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:08.126752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:08.126752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:08.126752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:08.126752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:08.126752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:08.126752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:08.127804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:08.127804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:08.127804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:08.127804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:08.127804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:08.127804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:08.127804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:13:08.127804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:13:08.127804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:13:08.127804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:13:08.127804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:08.127804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:08.127804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:08.127804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:08.127804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:08.127804 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:08.128643 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:08.128643 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:08.128643 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:08.128643 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:08.128643 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:08.128643 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:08.128643 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:08.128643 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:08.128643 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:08.128643 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:08.128643 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:13:08.128643 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:08.128643 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 19:13:08.128643 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:08.128643 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 339/663] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:13:07 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:13:08.139176 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c415a8-c44d-4736-8ce2-9e47819fb765 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:08.246135 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:08.261437 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0eaa29-ac03-4825-bd68-254bd805a1f6 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:08.265800 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c415a8-c44d-4736-8ce2-9e47819fb765 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:08.291220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:08.302830 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aaab5d-b037-4a9b-be60-66eb40e23595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:08.303745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaab5d-b037-4a9b-be60-66eb40e23595 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:08.304217 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaab5d-b037-4a9b-be60-66eb40e23595 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:08.304874 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaab5d-b037-4a9b-be60-66eb40e23595 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:08.305552 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aaab5d-b037-4a9b-be60-66eb40e23595 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:08.307133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aaab5d-b037-4a9b-be60-66eb40e23595 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:08.307918 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1481e45-0616-430b-b865-742d21acddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:08.308688 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1481e45-0616-430b-b865-742d21acddae None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:08.309113 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1481e45-0616-430b-b865-742d21acddae None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:08.309682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1481e45-0616-430b-b865-742d21acddae None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:08.310608 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1481e45-0616-430b-b865-742d21acddae None admin] RBAC: Adding query filter params (name=network) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:08.311063 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1481e45-0616-430b-b865-742d21acddae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:08.313150 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1481e45-0616-430b-b865-742d21acddae None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:08.318501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 340/664] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Aug 19 19:13:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:08.319711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-e3aaab5d-b037-4a9b-be60-66eb40e23595 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 19:13:08.319711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:08.319711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:13:08.319711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:13:08.319711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:13:08.319711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:13:08.319711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:13:08.319711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:08.319711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 19:13:08.319711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:08.319711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:08.319711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:08.319711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:08.319711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:08.319711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:08.319711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:08.319711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:08.321262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:08.321262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:08.321262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:08.321262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:08.321262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:08.321262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:08.321262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:13:08.321262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:13:08.321262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:13:08.321262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:13:08.321262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:08.321262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:08.321262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:08.321262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:08.321262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:08.321262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:08.322310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:08.322310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:08.322310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:08.322310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:08.322310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:08.322310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:08.322310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:08.322310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:08.322310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:08.322310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:08.322310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:13:08.322310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:08.322310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 19:13:08.322310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:08.322310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 325/665] 10.222.0.61 () {56 vars in 1129 bytes} [Fri Aug 19 19:13:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:13:08.327443 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1481e45-0616-430b-b865-742d21acddae None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:08.327806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aaab5d-b037-4a9b-be60-66eb40e23595 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:08.440966 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aaab5d-b037-4a9b-be60-66eb40e23595 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:08.458770 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1481e45-0616-430b-b865-742d21acddae None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:08.482570 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b4954-414d-4fb4-b4e8-154e476c0f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:08.483609 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b4954-414d-4fb4-b4e8-154e476c0f2f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:08.483888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b4954-414d-4fb4-b4e8-154e476c0f2f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:08.484165 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b4954-414d-4fb4-b4e8-154e476c0f2f None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:08.484800 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b4954-414d-4fb4-b4e8-154e476c0f2f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:08.485101 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b4954-414d-4fb4-b4e8-154e476c0f2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:08.487049 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b4954-414d-4fb4-b4e8-154e476c0f2f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:08.494616 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 326/666] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Aug 19 19:13:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:08.499017 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b4954-414d-4fb4-b4e8-154e476c0f2f None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:08.507509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64b3d8-a232-4957-bfa9-4b73e77c2f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:08.508229 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64b3d8-a232-4957-bfa9-4b73e77c2f31 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:08.508516 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64b3d8-a232-4957-bfa9-4b73e77c2f31 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:08.508825 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64b3d8-a232-4957-bfa9-4b73e77c2f31 None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:08.509637 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64b3d8-a232-4957-bfa9-4b73e77c2f31 None admin] RBAC: Adding query filter params (type=network) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:08.509949 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64b3d8-a232-4957-bfa9-4b73e77c2f31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:08.511609 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64b3d8-a232-4957-bfa9-4b73e77c2f31 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:08.519828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 341/667] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Aug 19 19:13:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:08.568265 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:08.624753 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b4954-414d-4fb4-b4e8-154e476c0f2f None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:08.664066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a609fd-b9cd-4959-ad3d-cb3d0466d6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:08.664691 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a609fd-b9cd-4959-ad3d-cb3d0466d6ed None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:08.664967 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a609fd-b9cd-4959-ad3d-cb3d0466d6ed None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:08.665240 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a609fd-b9cd-4959-ad3d-cb3d0466d6ed None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:08.665890 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a609fd-b9cd-4959-ad3d-cb3d0466d6ed None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:08.666192 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a609fd-b9cd-4959-ad3d-cb3d0466d6ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:08.667637 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a609fd-b9cd-4959-ad3d-cb3d0466d6ed None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:08.673270 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 327/668] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Aug 19 19:13:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:09.821941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff949a-1368-4c2d-b226-db04a04fabc1 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:09.822900 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff949a-1368-4c2d-b226-db04a04fabc1 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:09.823389 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff949a-1368-4c2d-b226-db04a04fabc1 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:09.825343 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 342/669] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:09.831447 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640340a-4169-4861-89c9-3d79d6be1669 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:09.832369 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640340a-4169-4861-89c9-3d79d6be1669 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:09.832847 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640340a-4169-4861-89c9-3d79d6be1669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:09.852695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-f640340a-4169-4861-89c9-3d79d6be1669 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:09.854204 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f640340a-4169-4861-89c9-3d79d6be1669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:09.925157 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 328/670] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:13:10.254274 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff949a-1368-4c2d-b226-db04a04fabc1 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:10.268997 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:10.313872 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bd67f-dad9-4559-9808-32d8bdb7d483 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:10.314378 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bd67f-dad9-4559-9808-32d8bdb7d483 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:10.314920 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bd67f-dad9-4559-9808-32d8bdb7d483 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:10.318036 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 329/671] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:10.323059 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d9373-28b8-441c-b9c6-6f1b6e8040e0 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:10.323651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d9373-28b8-441c-b9c6-6f1b6e8040e0 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:10.324204 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d9373-28b8-441c-b9c6-6f1b6e8040e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:10.345816 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-d57d9373-28b8-441c-b9c6-6f1b6e8040e0 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:10.347509 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d57d9373-28b8-441c-b9c6-6f1b6e8040e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:10.372618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff949a-1368-4c2d-b226-db04a04fabc1 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:10.395581 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:10.418957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc20bf7-81a5-4acd-9276-44f4a21b24fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:10.419911 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc20bf7-81a5-4acd-9276-44f4a21b24fb None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:10.420199 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc20bf7-81a5-4acd-9276-44f4a21b24fb None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:10.420469 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc20bf7-81a5-4acd-9276-44f4a21b24fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:10.430723 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 330/672] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:13:10.442049 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc20bf7-81a5-4acd-9276-44f4a21b24fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:13:10.447875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-3fc20bf7-81a5-4acd-9276-44f4a21b24fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:13:10.447875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:10.447875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:10.447875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:10.447875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:10.447875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:10.447875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:10.447875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:10.447875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:10.447875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:10.447875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:10.447875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:10.447875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:13:10.447875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:13:10.447875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:13:10.447875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:13:10.448808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:13:10.448808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:13:10.448808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:13:10.448808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:13:10.448808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:10.448808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:10.448808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:10.448808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:10.448808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:10.448808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:10.448808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:10.448808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:10.448808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:10.448808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:10.448808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:10.448808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:10.449630 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:10.449630 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:10.449630 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:10.449630 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:10.449630 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:13:10.449630 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:13:10.449630 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:13:10.449630 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:13:10.449630 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:13:10.449630 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:13:10.449630 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:13:10.449630 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:10.453055 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 343/673] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Aug 19 19:13:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:10.459112 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d9373-28b8-441c-b9c6-6f1b6e8040e0 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:10.573789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d9373-28b8-441c-b9c6-6f1b6e8040e0 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:10.609179 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7183b-9a1d-4676-a950-c7e1ec6f0cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:10.609755 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7183b-9a1d-4676-a950-c7e1ec6f0cd6 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:10.610029 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7183b-9a1d-4676-a950-c7e1ec6f0cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:10.610295 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7183b-9a1d-4676-a950-c7e1ec6f0cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:10.611051 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7183b-9a1d-4676-a950-c7e1ec6f0cd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:10.611349 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7183b-9a1d-4676-a950-c7e1ec6f0cd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:10.612712 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7183b-9a1d-4676-a950-c7e1ec6f0cd6 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:10.621845 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 331/674] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:13:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:10.627323 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc20bf7-81a5-4acd-9276-44f4a21b24fb None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:10.700880 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:10.737897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc20bf7-81a5-4acd-9276-44f4a21b24fb None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:10.776419 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d2f53-a6d5-4338-a363-f7cd7d08449a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:10.777412 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d2f53-a6d5-4338-a363-f7cd7d08449a None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:10.777892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d2f53-a6d5-4338-a363-f7cd7d08449a None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:10.778361 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d2f53-a6d5-4338-a363-f7cd7d08449a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:10.790749 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d2f53-a6d5-4338-a363-f7cd7d08449a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:10.792625 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d2f53-a6d5-4338-a363-f7cd7d08449a None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:10.809159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-308d2f53-a6d5-4338-a363-f7cd7d08449a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:10.809159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:10.809159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:10.809159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:10.809159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:10.809159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:10.809159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:10.809159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:10.809159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:10.809159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:10.809159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:10.809159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:10.809159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:13:10.809159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:13:10.809159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:13:10.809159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:13:10.810174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:10.810174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:10.810174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:10.810174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:10.810174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:10.810174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:10.810174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:10.810174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:10.810174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:10.810174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:10.810174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:10.810174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:10.810174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:10.810174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:10.810174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:10.810174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:10.810174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:13:10.811093 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:13:10.811093 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:10.811093 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:10.813357 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 344/675] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:10.819167 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7183b-9a1d-4676-a950-c7e1ec6f0cd6 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:10.820656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d2f53-a6d5-4338-a363-f7cd7d08449a None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:10.866419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:10.926906 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d2f53-a6d5-4338-a363-f7cd7d08449a None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:10.931842 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7183b-9a1d-4676-a950-c7e1ec6f0cd6 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:10.953391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:10.966290 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a62a2-af0d-41ae-8003-81f85f9580bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:10.966722 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a120e-08d2-4eb5-8c09-5d747da43116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:10.966949 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a62a2-af0d-41ae-8003-81f85f9580bb None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:10.967211 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a62a2-af0d-41ae-8003-81f85f9580bb None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:10.967313 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a120e-08d2-4eb5-8c09-5d747da43116 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:10.967481 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a62a2-af0d-41ae-8003-81f85f9580bb None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:10.967575 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a120e-08d2-4eb5-8c09-5d747da43116 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:10.967848 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a120e-08d2-4eb5-8c09-5d747da43116 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:10.968121 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a62a2-af0d-41ae-8003-81f85f9580bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:10.968424 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a62a2-af0d-41ae-8003-81f85f9580bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:10.968523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a120e-08d2-4eb5-8c09-5d747da43116 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:10.969821 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a120e-08d2-4eb5-8c09-5d747da43116 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:10.969939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a62a2-af0d-41ae-8003-81f85f9580bb None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:10.984021 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 345/676] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:13:10.985248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab1992-a4d9-45d5-bb05-f568a199644e None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:10.988839 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab1992-a4d9-45d5-bb05-f568a199644e None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:10.988839 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab1992-a4d9-45d5-bb05-f568a199644e None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:10.988839 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 346/677] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:10.988839 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de47f26-ff3f-49a3-a8d8-98fc20074f70 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:10.988839 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de47f26-ff3f-49a3-a8d8-98fc20074f70 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:10.988839 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de47f26-ff3f-49a3-a8d8-98fc20074f70 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:10.989747 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 347/678] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:10.990434 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de47f26-ff3f-49a3-a8d8-98fc20074f70 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:11.062753 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 332/679] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Aug 19 19:13:10 2022] POST /identity/v3/services => generated 242 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:13:11.064062 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ada237-22f5-4d83-85dc-7dde44a0f9d3 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:11.064357 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ada237-22f5-4d83-85dc-7dde44a0f9d3 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:11.064635 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ada237-22f5-4d83-85dc-7dde44a0f9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:11.085756 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-75ada237-22f5-4d83-85dc-7dde44a0f9d3 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:11.087383 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-75ada237-22f5-4d83-85dc-7dde44a0f9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:11.112208 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de47f26-ff3f-49a3-a8d8-98fc20074f70 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:11.151066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983a0ca-a965-4436-b928-cc71560abd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:11.152219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983a0ca-a965-4436-b928-cc71560abd80 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:11.152512 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983a0ca-a965-4436-b928-cc71560abd80 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:11.152792 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983a0ca-a965-4436-b928-cc71560abd80 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:11.161386 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983a0ca-a965-4436-b928-cc71560abd80 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:11.162927 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983a0ca-a965-4436-b928-cc71560abd80 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:11.169194 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 333/680] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:11 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:13:11.171176 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121446f-a760-4d8d-946f-e8322ce5542b None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:11.171598 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121446f-a760-4d8d-946f-e8322ce5542b None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:11.172047 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121446f-a760-4d8d-946f-e8322ce5542b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:11.175328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-b983a0ca-a965-4436-b928-cc71560abd80 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:13:11.175328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:11.175328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:11.175328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:11.175328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:11.175328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:11.175328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:11.175328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:11.175328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:11.175328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:11.175328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:11.175328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:11.175328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:13:11.175328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:13:11.175328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:13:11.175328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:13:11.176296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:11.176296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:11.176296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:13:11.176296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:13:11.176296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:13:11.176296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:13:11.176296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:11.176296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:11.176296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:11.176296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:11.176296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:11.176296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:11.176296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:11.176296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:11.176296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:11.176296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:11.176296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:11.176296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:11.177305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:11.177305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:11.177305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:13:11.177305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:13:11.177305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:13:11.177305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:13:11.177305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:13:11.177305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:13:11.177305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:13:11.177305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:11.181699 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 348/681] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Aug 19 19:13:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:11.182892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983a0ca-a965-4436-b928-cc71560abd80 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:11.201660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-9121446f-a760-4d8d-946f-e8322ce5542b None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:11.203485 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9121446f-a760-4d8d-946f-e8322ce5542b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:11.232405 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:11.244725 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:11.301000 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 334/682] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:11 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 19:13:11.307077 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983a0ca-a965-4436-b928-cc71560abd80 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:11.348155 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b8a56-64f4-4f7d-a850-9baf255fae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:11.348766 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b8a56-64f4-4f7d-a850-9baf255fae87 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:11.349040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b8a56-64f4-4f7d-a850-9baf255fae87 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:11.349305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b8a56-64f4-4f7d-a850-9baf255fae87 None admin] PATH_INFO: `/v3/users` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:11.350030 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b8a56-64f4-4f7d-a850-9baf255fae87 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:11.350332 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b8a56-64f4-4f7d-a850-9baf255fae87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:11.351852 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b8a56-64f4-4f7d-a850-9baf255fae87 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:11.373954 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 349/683] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Aug 19 19:13:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:13:11.379353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121446f-a760-4d8d-946f-e8322ce5542b None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:11.487357 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121446f-a760-4d8d-946f-e8322ce5542b None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:11.519743 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b8a56-64f4-4f7d-a850-9baf255fae87 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:11.524379 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca6310-63b5-4d67-866f-5d22c5089cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:11.525091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca6310-63b5-4d67-866f-5d22c5089cdb None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:11.525373 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca6310-63b5-4d67-866f-5d22c5089cdb None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:11.525649 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca6310-63b5-4d67-866f-5d22c5089cdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:11.538630 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca6310-63b5-4d67-866f-5d22c5089cdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:11.540327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca6310-63b5-4d67-866f-5d22c5089cdb None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:11.560245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-c6ca6310-63b5-4d67-866f-5d22c5089cdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:11.560245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:11.560245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:11.560245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:11.560245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:11.560245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:11.560245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:11.560245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:11.560245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:11.560245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:11.560245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:11.560245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:11.560245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:13:11.560245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:13:11.560245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:13:11.560245 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:13:11.561235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:11.561235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:11.561235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:11.561235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:11.561235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:11.561235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:11.561235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:11.561235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:11.561235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:11.561235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:11.561235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:11.561235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:11.561235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:11.561235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:11.561235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:11.561235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:11.561235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:13:11.562124 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:13:11.562124 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:11.562124 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:11.567037 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 335/684] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:11.568399 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca6310-63b5-4d67-866f-5d22c5089cdb None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:11.590945 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:11.641609 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:11.648776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b8a56-64f4-4f7d-a850-9baf255fae87 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:11.685071 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41796dac-8259-4347-b2b8-d97b93aa049b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:11.685677 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41796dac-8259-4347-b2b8-d97b93aa049b None admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:11.686725 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41796dac-8259-4347-b2b8-d97b93aa049b None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:11.686725 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41796dac-8259-4347-b2b8-d97b93aa049b None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:11.686940 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41796dac-8259-4347-b2b8-d97b93aa049b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:11.688206 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41796dac-8259-4347-b2b8-d97b93aa049b None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:11.706755 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca6310-63b5-4d67-866f-5d22c5089cdb None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:11.741282 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af613be5-abdf-40b7-90a9-67f534ca9697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:11.741884 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af613be5-abdf-40b7-90a9-67f534ca9697 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:11.742159 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af613be5-abdf-40b7-90a9-67f534ca9697 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:11.742430 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af613be5-abdf-40b7-90a9-67f534ca9697 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:11.743099 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af613be5-abdf-40b7-90a9-67f534ca9697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:11.743416 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af613be5-abdf-40b7-90a9-67f534ca9697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:11.744773 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af613be5-abdf-40b7-90a9-67f534ca9697 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:11.758075 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 336/685] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:13:11.758945 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af613be5-abdf-40b7-90a9-67f534ca9697 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:11.762963 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 350/686] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Aug 19 19:13:11 2022] POST /identity/v3/services => generated 240 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:13:11.764002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41796dac-8259-4347-b2b8-d97b93aa049b None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:11.854832 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:11.890480 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af613be5-abdf-40b7-90a9-67f534ca9697 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:11.897245 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41796dac-8259-4347-b2b8-d97b93aa049b None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:11.931207 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ead222-9607-407f-b06c-200147dd5370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:11.931924 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ead222-9607-407f-b06c-200147dd5370 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:11.932206 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ead222-9607-407f-b06c-200147dd5370 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:11.932573 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ead222-9607-407f-b06c-200147dd5370 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:11.933235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ead222-9607-407f-b06c-200147dd5370 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:11.935025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ead222-9607-407f-b06c-200147dd5370 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:11.937393 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76aa4a5-e6ea-44e0-b9fb-ecbdce9a8000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:11.938088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aa4a5-e6ea-44e0-b9fb-ecbdce9a8000 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:11.938372 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aa4a5-e6ea-44e0-b9fb-ecbdce9a8000 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:11.938805 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aa4a5-e6ea-44e0-b9fb-ecbdce9a8000 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:11.946938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76aa4a5-e6ea-44e0-b9fb-ecbdce9a8000 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:11.948507 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76aa4a5-e6ea-44e0-b9fb-ecbdce9a8000 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:11.961352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-a76aa4a5-e6ea-44e0-b9fb-ecbdce9a8000 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:13:11.961352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:11.961352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:11.961352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:11.961352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:11.961352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:11.961352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:11.961352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:11.961352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:11.961352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:11.961352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:11.961352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:11.961352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:13:11.961352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:13:11.961352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:13:11.962633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:13:11.962633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:11.962633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:11.962633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:11.962633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:11.962633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:11.962633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:11.962633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:11.962633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:11.962633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:11.962633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:11.962633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:11.962633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:11.962633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:11.962633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:11.962633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:11.962633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:11.964706 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:13:11.964706 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:13:11.964706 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:13:11.964706 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:13:11.964706 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:13:11.964706 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:13:11.964706 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:13:11.964706 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:11.964706 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 351/687] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:13:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:11.968413 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76aa4a5-e6ea-44e0-b9fb-ecbdce9a8000 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:11.989942 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:11.990744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 337/688] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Aug 19 19:13:11 2022] POST /identity/v3/services => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:13:12.094026 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76aa4a5-e6ea-44e0-b9fb-ecbdce9a8000 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:12.139728 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d8a59-e2c1-46a3-a220-c7c871582ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:12.140347 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d8a59-e2c1-46a3-a220-c7c871582ac7 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:12.140629 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d8a59-e2c1-46a3-a220-c7c871582ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:12.140899 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d8a59-e2c1-46a3-a220-c7c871582ac7 None admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:12.141610 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d8a59-e2c1-46a3-a220-c7c871582ac7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:12.141916 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d8a59-e2c1-46a3-a220-c7c871582ac7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:12.143503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d8a59-e2c1-46a3-a220-c7c871582ac7 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:12.162685 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 352/689] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:13:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:13:12.167673 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ead222-9607-407f-b06c-200147dd5370 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:12.279256 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ead222-9607-407f-b06c-200147dd5370 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:12.312595 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:12.318912 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a766e9-af6a-4d06-90c6-0a5722fb7291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:12.319607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a766e9-af6a-4d06-90c6-0a5722fb7291 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:12.319920 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a766e9-af6a-4d06-90c6-0a5722fb7291 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:12.320196 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a766e9-af6a-4d06-90c6-0a5722fb7291 None admin] PATH_INFO: `/v3/projects/409a043500554125a93c4636db5a6812/users/54c899e786614c18b2bf4334ceb2f891/roles/8fdfbc4aaf68468f89a5ae3450b8488d` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:12.322151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a766e9-af6a-4d06-90c6-0a5722fb7291 None admin] RBAC: Authorizing `identity:create_grant(project_id=409a043500554125a93c4636db5a6812, user_id=54c899e786614c18b2bf4334ceb2f891, role_id=8fdfbc4aaf68468f89a5ae3450b8488d)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:12.323649 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a766e9-af6a-4d06-90c6-0a5722fb7291 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:12.414621 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 338/690] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Aug 19 19:13:12 2022] PUT /identity/v3/projects/409a043500554125a93c4636db5a6812/users/54c899e786614c18b2bf4334ceb2f891/roles/8fdfbc4aaf68468f89a5ae3450b8488d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:13:13.455707 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cbfea-dc43-4b16-8f7f-701aeab62d70 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:13.456415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cbfea-dc43-4b16-8f7f-701aeab62d70 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:13.456415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cbfea-dc43-4b16-8f7f-701aeab62d70 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:13.457818 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 353/691] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:13.463201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c50b97-327c-4b97-a7fd-2095fd91dade None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:13.463723 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c50b97-327c-4b97-a7fd-2095fd91dade None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:13.463723 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c50b97-327c-4b97-a7fd-2095fd91dade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:13.482623 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-57c50b97-327c-4b97-a7fd-2095fd91dade None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:13.483806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-57c50b97-327c-4b97-a7fd-2095fd91dade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:13.559752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 339/692] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:13 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:13:13.892912 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cbfea-dc43-4b16-8f7f-701aeab62d70 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:13.970559 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:14.008087 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cbfea-dc43-4b16-8f7f-701aeab62d70 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:14.050637 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc67490-fa7b-4fa4-91be-84efafb7ef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:14.051270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc67490-fa7b-4fa4-91be-84efafb7ef2e None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:14.051554 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc67490-fa7b-4fa4-91be-84efafb7ef2e None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:14.051826 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc67490-fa7b-4fa4-91be-84efafb7ef2e None admin] PATH_INFO: `/v3/services/image` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:14.052413 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc67490-fa7b-4fa4-91be-84efafb7ef2e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:14.053833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc67490-fa7b-4fa4-91be-84efafb7ef2e None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:14.063438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-7fc67490-fa7b-4fa4-91be-84efafb7ef2e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 19:13:14.063438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:14.063438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:13:14.063438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:13:14.063438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:13:14.063438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:13:14.063438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:13:14.063438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:14.063438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 19:13:14.063438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:14.063438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:14.063438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:14.063438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:14.063438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:14.063438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:14.063438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:14.063438 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:14.064503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:14.064503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:14.064503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:14.064503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:14.064503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:14.064503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:14.064503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:13:14.064503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:13:14.064503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:13:14.064503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:13:14.064503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:14.064503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:14.064503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:14.064503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:14.064503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:14.064503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:14.065349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:14.065349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:14.065349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:14.065349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:14.065349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:14.065349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:14.065349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:14.065349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:14.065349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:14.065349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:14.065349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:13:14.065349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:14.065349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 19:13:14.065349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:14.065349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 354/693] 10.222.0.61 () {56 vars in 1105 bytes} [Fri Aug 19 19:13:13 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:14.071022 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c50b97-327c-4b97-a7fd-2095fd91dade None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:14.131442 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee91053-88f4-4404-8736-474f2942ea39 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:14.131770 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee91053-88f4-4404-8736-474f2942ea39 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:14.132546 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee91053-88f4-4404-8736-474f2942ea39 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:14.135820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 355/694] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:14.139902 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd027f-25c9-4730-83a0-b7782bdb6838 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:14.140183 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd027f-25c9-4730-83a0-b7782bdb6838 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:14.140503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd027f-25c9-4730-83a0-b7782bdb6838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:14.159993 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-91bd027f-25c9-4730-83a0-b7782bdb6838 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:14.161134 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-91bd027f-25c9-4730-83a0-b7782bdb6838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:14.181562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c50b97-327c-4b97-a7fd-2095fd91dade None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:14.205154 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:14.221594 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06524b-2f27-4e32-b574-68674d3b1084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:14.222073 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06524b-2f27-4e32-b574-68674d3b1084 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:14.222345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06524b-2f27-4e32-b574-68674d3b1084 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:14.222645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06524b-2f27-4e32-b574-68674d3b1084 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:14.223319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06524b-2f27-4e32-b574-68674d3b1084 None admin] RBAC: Adding query filter params (name=image) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:14.223575 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06524b-2f27-4e32-b574-68674d3b1084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:14.225084 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06524b-2f27-4e32-b574-68674d3b1084 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:14.231248 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 340/695] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:14.236519 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06524b-2f27-4e32-b574-68674d3b1084 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:14.258624 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 356/696] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:14 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 19:13:14.354308 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06524b-2f27-4e32-b574-68674d3b1084 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:14.364191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245479c6-3eb3-4234-99eb-e800e3bdb233 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:14.364478 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245479c6-3eb3-4234-99eb-e800e3bdb233 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:14.364748 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245479c6-3eb3-4234-99eb-e800e3bdb233 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:14.366869 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 357/697] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:13:14.372131 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdc1ad-75da-431e-8bde-29c3bf360d71 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:14.372416 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdc1ad-75da-431e-8bde-29c3bf360d71 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:14.372686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdc1ad-75da-431e-8bde-29c3bf360d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:14.390823 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-4ccdc1ad-75da-431e-8bde-29c3bf360d71 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:14.391966 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd38b73-3339-49ca-a1cb-a1658d66a092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:14.392123 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-4ccdc1ad-75da-431e-8bde-29c3bf360d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:14.392574 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd38b73-3339-49ca-a1cb-a1658d66a092 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:14.392853 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd38b73-3339-49ca-a1cb-a1658d66a092 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:14.393123 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd38b73-3339-49ca-a1cb-a1658d66a092 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:14.394002 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd38b73-3339-49ca-a1cb-a1658d66a092 None admin] RBAC: Adding query filter params (type=image) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:14.394306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd38b73-3339-49ca-a1cb-a1658d66a092 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:14.396629 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd38b73-3339-49ca-a1cb-a1658d66a092 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:14.403256 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 341/698] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:14.409625 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd38b73-3339-49ca-a1cb-a1658d66a092 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:14.455979 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:14.472064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 358/699] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:14 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 19:13:14.472568 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:14.522404 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd38b73-3339-49ca-a1cb-a1658d66a092 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:14.559259 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9882d7-430c-43b7-a63c-16fee2d24c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:14.559956 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9882d7-430c-43b7-a63c-16fee2d24c77 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:14.560237 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9882d7-430c-43b7-a63c-16fee2d24c77 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:14.560510 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9882d7-430c-43b7-a63c-16fee2d24c77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:14.561206 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9882d7-430c-43b7-a63c-16fee2d24c77 None admin] RBAC: Adding query filter params (interface=public, service_id=f1a682b7a7a842568aa70d42e8efae5a, region_id=RegionOne) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:14.561506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9882d7-430c-43b7-a63c-16fee2d24c77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:14.562901 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9882d7-430c-43b7-a63c-16fee2d24c77 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:14.572087 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 342/700] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Aug 19 19:13:14 2022] GET /identity/v3/endpoints?service_id=f1a682b7a7a842568aa70d42e8efae5a&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:13:14.577999 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdc1ad-75da-431e-8bde-29c3bf360d71 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:14.620060 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9882d7-430c-43b7-a63c-16fee2d24c77 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:14.690900 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdc1ad-75da-431e-8bde-29c3bf360d71 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:14.728254 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9882d7-430c-43b7-a63c-16fee2d24c77 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:14.733835 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e513ca-20b0-4422-9f69-2f523ab39e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:14.734631 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e513ca-20b0-4422-9f69-2f523ab39e0a None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:14.735439 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e513ca-20b0-4422-9f69-2f523ab39e0a None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:14.735861 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e513ca-20b0-4422-9f69-2f523ab39e0a None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:14.736600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e513ca-20b0-4422-9f69-2f523ab39e0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:14.738797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e513ca-20b0-4422-9f69-2f523ab39e0a None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:14.741123 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:14.745941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 359/701] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Aug 19 19:13:14 2022] GET /identity/v3/services => generated 1002 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:13:14.747223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4237a7b-e9dd-4e41-8af7-7ab03a639506 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:14.747503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4237a7b-e9dd-4e41-8af7-7ab03a639506 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:14.747774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4237a7b-e9dd-4e41-8af7-7ab03a639506 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:14.749349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 360/702] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:14.764664 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91802b-fd96-44ea-9c08-a1ca83a524ef None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:14.765248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91802b-fd96-44ea-9c08-a1ca83a524ef None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:14.765927 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91802b-fd96-44ea-9c08-a1ca83a524ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:14.772279 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50305f04-bdf9-4c06-9896-3d39a85d34c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:14.773095 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50305f04-bdf9-4c06-9896-3d39a85d34c5 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:14.773435 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50305f04-bdf9-4c06-9896-3d39a85d34c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:14.773771 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50305f04-bdf9-4c06-9896-3d39a85d34c5 None admin] PATH_INFO: `/v3/services/network` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:14.775219 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50305f04-bdf9-4c06-9896-3d39a85d34c5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:14.778163 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50305f04-bdf9-4c06-9896-3d39a85d34c5 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:14.789055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-50305f04-bdf9-4c06-9896-3d39a85d34c5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 19:13:14.789055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:14.789055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:13:14.789055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:13:14.789055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:13:14.789055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:13:14.789055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:13:14.789055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:14.789055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 19:13:14.789055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:14.789055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:14.789055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:14.789055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:14.789055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:14.789055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:14.789055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:14.789055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:14.790306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:14.790306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:14.790306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:14.790306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:14.790306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:14.790306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:14.790306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:13:14.790306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:13:14.790306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:13:14.790306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:13:14.790306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:14.790306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:14.790306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:14.790306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:14.790306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:14.790306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:14.791366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:14.791366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:14.791366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:14.791366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:14.791366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:14.791366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:14.791366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:14.791366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:14.791366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:14.791366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:14.791366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:13:14.791366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:14.791366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 19:13:14.791366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:14.792149 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 343/703] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:13:14 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:13:14.792908 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-9e91802b-fd96-44ea-9c08-a1ca83a524ef None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:14.794351 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-9e91802b-fd96-44ea-9c08-a1ca83a524ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:14.797842 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50305f04-bdf9-4c06-9896-3d39a85d34c5 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:14.861355 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:14.879981 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 361/704] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:14 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 19:13:14.880977 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91802b-fd96-44ea-9c08-a1ca83a524ef None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:14.941930 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50305f04-bdf9-4c06-9896-3d39a85d34c5 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:14.985149 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207163ee-f774-4e6e-b2ff-8d35d7976a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:14.985847 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207163ee-f774-4e6e-b2ff-8d35d7976a94 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:14.986221 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207163ee-f774-4e6e-b2ff-8d35d7976a94 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:14.986661 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207163ee-f774-4e6e-b2ff-8d35d7976a94 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:14.987407 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207163ee-f774-4e6e-b2ff-8d35d7976a94 None admin] RBAC: Adding query filter params (name=network) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:14.987809 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207163ee-f774-4e6e-b2ff-8d35d7976a94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:14.989329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207163ee-f774-4e6e-b2ff-8d35d7976a94 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:15.001013 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 344/705] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Aug 19 19:13:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:15.002778 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207163ee-f774-4e6e-b2ff-8d35d7976a94 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:15.055431 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:15.127110 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91802b-fd96-44ea-9c08-a1ca83a524ef None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:15.135795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207163ee-f774-4e6e-b2ff-8d35d7976a94 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:15.162461 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc14d8d-be1d-4742-ba77-7fcf95e3cbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:15.163835 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc14d8d-be1d-4742-ba77-7fcf95e3cbf3 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:15.164586 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc14d8d-be1d-4742-ba77-7fcf95e3cbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:15.164859 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc14d8d-be1d-4742-ba77-7fcf95e3cbf3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:15.165449 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc14d8d-be1d-4742-ba77-7fcf95e3cbf3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:15.166861 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc14d8d-be1d-4742-ba77-7fcf95e3cbf3 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:15.175967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-0fc14d8d-be1d-4742-ba77-7fcf95e3cbf3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 19:13:15.175967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:15.175967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:13:15.175967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:13:15.175967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:13:15.175967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:13:15.175967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:13:15.175967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:15.175967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 19:13:15.175967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:15.175967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:15.175967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:15.175967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:15.175967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:15.175967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:15.175967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:15.175967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:15.176975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:15.176975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:15.176975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:15.176975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:15.176975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:15.176975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:15.176975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:13:15.176975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:13:15.176975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:13:15.176975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:13:15.176975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:15.176975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:15.176975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:15.176975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:15.176975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:15.176975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:15.178479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:15.178479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:15.178479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:15.178479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:15.178479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:15.178479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:15.178479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:15.178479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:15.178479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:15.178479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:15.178479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:13:15.178479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:15.178479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 19:13:15.178479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:15.178479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 362/706] 10.222.0.61 () {56 vars in 1129 bytes} [Fri Aug 19 19:13:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:15.183380 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc14d8d-be1d-4742-ba77-7fcf95e3cbf3 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:15.186510 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e85fd-c931-4b9e-bc2e-f6b0e15d334b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:15.187420 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e85fd-c931-4b9e-bc2e-f6b0e15d334b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:15.187905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e85fd-c931-4b9e-bc2e-f6b0e15d334b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:15.188431 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e85fd-c931-4b9e-bc2e-f6b0e15d334b None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:15.189404 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e85fd-c931-4b9e-bc2e-f6b0e15d334b None admin] RBAC: Adding query filter params (type=network) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:15.189773 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e85fd-c931-4b9e-bc2e-f6b0e15d334b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:15.191558 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e85fd-c931-4b9e-bc2e-f6b0e15d334b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:15.197652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 345/707] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Aug 19 19:13:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:13:15.203616 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e85fd-c931-4b9e-bc2e-f6b0e15d334b None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:15.240154 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:15.302571 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc14d8d-be1d-4742-ba77-7fcf95e3cbf3 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:15.326938 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e85fd-c931-4b9e-bc2e-f6b0e15d334b None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:15.330104 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:15.346558 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812a99c-b358-416e-acc6-92753a12a0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:15.347482 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812a99c-b358-416e-acc6-92753a12a0a2 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:15.347981 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812a99c-b358-416e-acc6-92753a12a0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:15.348453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812a99c-b358-416e-acc6-92753a12a0a2 None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:15.349181 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812a99c-b358-416e-acc6-92753a12a0a2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:15.349630 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812a99c-b358-416e-acc6-92753a12a0a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:15.351304 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812a99c-b358-416e-acc6-92753a12a0a2 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:15.356056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 363/708] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Aug 19 19:13:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:13:15.356941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812a99c-b358-416e-acc6-92753a12a0a2 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:15.369077 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edf3b0-5cef-4d92-80ab-fa96489f0ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:15.373998 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edf3b0-5cef-4d92-80ab-fa96489f0ee3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:15.373998 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edf3b0-5cef-4d92-80ab-fa96489f0ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:15.373998 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edf3b0-5cef-4d92-80ab-fa96489f0ee3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:15.373998 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edf3b0-5cef-4d92-80ab-fa96489f0ee3 None admin] RBAC: Adding query filter params (interface=public, service_id=dcadb461f4bb45aeadffd2aa246392af, region_id=RegionOne) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:15.373998 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edf3b0-5cef-4d92-80ab-fa96489f0ee3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:15.373998 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edf3b0-5cef-4d92-80ab-fa96489f0ee3 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:15.383872 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 346/709] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Aug 19 19:13:15 2022] GET /identity/v3/endpoints?service_id=dcadb461f4bb45aeadffd2aa246392af&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:15.383872 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edf3b0-5cef-4d92-80ab-fa96489f0ee3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:15.479624 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812a99c-b358-416e-acc6-92753a12a0a2 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:15.496294 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:15.504303 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edf3b0-5cef-4d92-80ab-fa96489f0ee3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:15.519315 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd12d3-4205-44af-85b3-78c74dfbd8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:15.521062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd12d3-4205-44af-85b3-78c74dfbd8f2 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:15.521062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd12d3-4205-44af-85b3-78c74dfbd8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:15.521062 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd12d3-4205-44af-85b3-78c74dfbd8f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:15.532113 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd12d3-4205-44af-85b3-78c74dfbd8f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:13:15.536779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-68cd12d3-4205-44af-85b3-78c74dfbd8f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:13:15.536779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:15.536779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:15.536779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:15.536779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:15.536779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:15.536779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:15.536779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:15.536779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:15.536779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:15.536779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:15.536779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:15.536779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:13:15.536779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:13:15.536779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:13:15.536779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:13:15.537752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:13:15.537752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:13:15.537752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:13:15.537752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:13:15.537752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:15.537752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:15.537752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:15.537752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:15.537752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:15.537752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:15.537752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:15.537752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:15.537752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:15.537752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:15.537752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:15.537752 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:15.538768 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:15.538768 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:15.538768 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:15.538768 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:15.538768 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:13:15.538768 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:13:15.538768 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:13:15.538768 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:13:15.538768 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:13:15.538768 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:13:15.538768 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:13:15.538768 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:15.538768 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 364/710] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Aug 19 19:13:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:15.539448 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd12d3-4205-44af-85b3-78c74dfbd8f2 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:15.561874 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da2019-5c35-4fda-b778-dabbaecdbe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:15.562580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da2019-5c35-4fda-b778-dabbaecdbe8d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:15.562918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da2019-5c35-4fda-b778-dabbaecdbe8d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:15.563286 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da2019-5c35-4fda-b778-dabbaecdbe8d None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:15.563993 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da2019-5c35-4fda-b778-dabbaecdbe8d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:15.564369 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da2019-5c35-4fda-b778-dabbaecdbe8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:15.565885 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da2019-5c35-4fda-b778-dabbaecdbe8d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:15.580713 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 347/711] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Aug 19 19:13:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:15.580713 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da2019-5c35-4fda-b778-dabbaecdbe8d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:15.624953 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:15.662882 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd12d3-4205-44af-85b3-78c74dfbd8f2 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:15.697746 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c787572-1c37-4957-9c3e-87a7c2d681a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:15.698353 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c787572-1c37-4957-9c3e-87a7c2d681a9 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:15.698663 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c787572-1c37-4957-9c3e-87a7c2d681a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:15.698939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c787572-1c37-4957-9c3e-87a7c2d681a9 None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:15.699563 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c787572-1c37-4957-9c3e-87a7c2d681a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:15.700922 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c787572-1c37-4957-9c3e-87a7c2d681a9 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:15.703794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da2019-5c35-4fda-b778-dabbaecdbe8d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:15.706743 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 365/712] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Aug 19 19:13:15 2022] GET /identity/v3/services => generated 1002 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:13:15.707607 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c787572-1c37-4957-9c3e-87a7c2d681a9 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:15.754268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c0c0b-d488-4f60-8dff-e33d96a09729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:15.755027 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:15.756364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c0c0b-d488-4f60-8dff-e33d96a09729 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:15.756900 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c0c0b-d488-4f60-8dff-e33d96a09729 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:15.757549 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c0c0b-d488-4f60-8dff-e33d96a09729 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:15.758449 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c0c0b-d488-4f60-8dff-e33d96a09729 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:15.758999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c0c0b-d488-4f60-8dff-e33d96a09729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:15.760828 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c0c0b-d488-4f60-8dff-e33d96a09729 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:15.771267 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 348/713] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:13:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:15.779269 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c0c0b-d488-4f60-8dff-e33d96a09729 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:15.847277 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c787572-1c37-4957-9c3e-87a7c2d681a9 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:15.903218 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04133213-d472-4fc1-ae42-9837e4bffc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:15.903448 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04133213-d472-4fc1-ae42-9837e4bffc66 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:15.903674 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04133213-d472-4fc1-ae42-9837e4bffc66 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:15.903857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04133213-d472-4fc1-ae42-9837e4bffc66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:15.904562 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04133213-d472-4fc1-ae42-9837e4bffc66 None admin] RBAC: Adding query filter params (interface=public, service_id=79720af01f7244958fe8cc52ce35f37b, region_id=RegionOne) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:15.905050 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04133213-d472-4fc1-ae42-9837e4bffc66 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:15.906209 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04133213-d472-4fc1-ae42-9837e4bffc66 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:15.917517 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 366/714] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Aug 19 19:13:15 2022] GET /identity/v3/endpoints?service_id=79720af01f7244958fe8cc52ce35f37b&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:15.920436 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:15.921402 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04133213-d472-4fc1-ae42-9837e4bffc66 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:15.929016 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c0c0b-d488-4f60-8dff-e33d96a09729 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:15.976635 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb229c-4b0f-49ea-b1f7-7684f8b20951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:15.977783 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb229c-4b0f-49ea-b1f7-7684f8b20951 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:15.978205 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb229c-4b0f-49ea-b1f7-7684f8b20951 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:15.978648 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb229c-4b0f-49ea-b1f7-7684f8b20951 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:15.992893 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb229c-4b0f-49ea-b1f7-7684f8b20951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:15.995737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb229c-4b0f-49ea-b1f7-7684f8b20951 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:16.012651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-1ddb229c-4b0f-49ea-b1f7-7684f8b20951 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:16.012651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:16.012651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:16.012651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:16.012651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:16.012651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:16.012651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:16.012651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:16.012651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:16.012651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:16.012651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:16.012651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:16.012651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:13:16.012651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:13:16.012651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:13:16.012651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:13:16.013795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:16.013795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:16.013795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:16.013795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:16.013795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:16.013795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:16.013795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:16.013795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:16.013795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:16.013795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:16.013795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:16.013795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:16.013795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:16.013795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:16.013795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:16.013795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:16.013795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:13:16.014877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:13:16.014877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:16.014877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:16.016568 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 349/715] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:13:16.025203 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb229c-4b0f-49ea-b1f7-7684f8b20951 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:16.055380 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04133213-d472-4fc1-ae42-9837e4bffc66 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:16.057926 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:16.107631 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8291c28-0ae3-43b7-9c2d-e02afdb2d5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:16.108606 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8291c28-0ae3-43b7-9c2d-e02afdb2d5ed None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:16.109082 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8291c28-0ae3-43b7-9c2d-e02afdb2d5ed None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:16.109570 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8291c28-0ae3-43b7-9c2d-e02afdb2d5ed None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:16.110869 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8291c28-0ae3-43b7-9c2d-e02afdb2d5ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:16.112907 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8291c28-0ae3-43b7-9c2d-e02afdb2d5ed None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:16.122347 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 367/716] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Aug 19 19:13:15 2022] GET /identity/v3/services => generated 1002 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 19:13:16.144662 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb229c-4b0f-49ea-b1f7-7684f8b20951 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:16.186590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa324e-aaa7-40ad-a270-a7139d3c18e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:16.187626 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa324e-aaa7-40ad-a270-a7139d3c18e6 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:16.188161 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa324e-aaa7-40ad-a270-a7139d3c18e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:16.188627 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa324e-aaa7-40ad-a270-a7139d3c18e6 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:16.189545 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa324e-aaa7-40ad-a270-a7139d3c18e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:16.190061 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa324e-aaa7-40ad-a270-a7139d3c18e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:16.192027 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa324e-aaa7-40ad-a270-a7139d3c18e6 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:16.207286 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 350/717] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:16.213830 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8291c28-0ae3-43b7-9c2d-e02afdb2d5ed None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:16.329849 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8291c28-0ae3-43b7-9c2d-e02afdb2d5ed None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:16.367108 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3461ba-c878-4e72-ae91-541805ed23cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:16.367736 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3461ba-c878-4e72-ae91-541805ed23cb None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:16.368012 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3461ba-c878-4e72-ae91-541805ed23cb None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:16.368285 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3461ba-c878-4e72-ae91-541805ed23cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:16.376010 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3461ba-c878-4e72-ae91-541805ed23cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:16.377432 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3461ba-c878-4e72-ae91-541805ed23cb None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:16.389501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-ab3461ba-c878-4e72-ae91-541805ed23cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:13:16.389501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:16.389501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:16.389501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:16.389501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:16.389501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:16.389501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:16.389501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:16.389501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:16.389501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:16.389501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:16.389501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:16.389501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:13:16.389501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:13:16.389501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:13:16.389501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:13:16.390453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:16.390453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:16.390453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:13:16.390453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:13:16.390453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:13:16.390453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:13:16.390453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:16.390453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:16.390453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:16.390453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:16.390453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:16.390453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:16.390453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:16.390453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:16.390453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:16.390453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:16.390453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:16.390453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:16.391603 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:16.391603 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:16.391603 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:13:16.391603 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:13:16.391603 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:13:16.391603 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:13:16.391603 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:13:16.391603 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:13:16.391603 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 19:13:16.391603 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:16.391603 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 368/718] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Aug 19 19:13:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:16.399662 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa324e-aaa7-40ad-a270-a7139d3c18e6 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:16.411737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:16.515303 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa324e-aaa7-40ad-a270-a7139d3c18e6 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:16.551149 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431d1f6-5cab-4500-bd35-8ca2a3c3a162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:16.551810 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431d1f6-5cab-4500-bd35-8ca2a3c3a162 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:16.552091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431d1f6-5cab-4500-bd35-8ca2a3c3a162 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:16.552363 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431d1f6-5cab-4500-bd35-8ca2a3c3a162 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:16.553088 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431d1f6-5cab-4500-bd35-8ca2a3c3a162 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:16.553394 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431d1f6-5cab-4500-bd35-8ca2a3c3a162 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:16.555602 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431d1f6-5cab-4500-bd35-8ca2a3c3a162 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:16.579598 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 351/719] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Aug 19 19:13:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:16.585701 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3461ba-c878-4e72-ae91-541805ed23cb None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:16.615425 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:16.693193 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3461ba-c878-4e72-ae91-541805ed23cb None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:16.731575 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1720cee-a704-405b-9881-92a3ec139bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:16.732543 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1720cee-a704-405b-9881-92a3ec139bb2 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:16.733047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1720cee-a704-405b-9881-92a3ec139bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:16.733517 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1720cee-a704-405b-9881-92a3ec139bb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:16.806378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1720cee-a704-405b-9881-92a3ec139bb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:16.808207 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1720cee-a704-405b-9881-92a3ec139bb2 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:16.837431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:16.924995 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 369/720] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:13:16 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 19:13:16.931731 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431d1f6-5cab-4500-bd35-8ca2a3c3a162 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:17.002456 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:17.041215 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431d1f6-5cab-4500-bd35-8ca2a3c3a162 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:17.083425 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0919e96-cea9-4687-9943-0631e30b812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:17.084056 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0919e96-cea9-4687-9943-0631e30b812a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:17.084330 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0919e96-cea9-4687-9943-0631e30b812a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:17.084600 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0919e96-cea9-4687-9943-0631e30b812a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:17.095433 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0919e96-cea9-4687-9943-0631e30b812a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:17.096811 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0919e96-cea9-4687-9943-0631e30b812a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:17.111514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-c0919e96-cea9-4687-9943-0631e30b812a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:17.111514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:17.111514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:17.111514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:17.111514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:17.111514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:17.111514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:17.111514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:17.111514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:17.111514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:17.111514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:17.111514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:17.111514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:13:17.111514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:13:17.111514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:13:17.111514 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:13:17.112460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:17.112460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:17.112460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:17.112460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:17.112460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:17.112460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:17.112460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:17.112460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:17.112460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:17.112460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:17.112460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:17.112460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:17.112460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:17.112460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:17.112460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:17.112460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:17.112460 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:13:17.113354 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:13:17.113354 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:17.113354 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:17.113354 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 352/721] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:17.119641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1720cee-a704-405b-9881-92a3ec139bb2 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:17.149438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7eaf84-2551-4111-9253-c900f702c34e None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:17.150054 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7eaf84-2551-4111-9253-c900f702c34e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:17.150334 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7eaf84-2551-4111-9253-c900f702c34e None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:17.152364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 353/722] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:13:17.159000 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7c9fb-e885-4e59-829e-5b4c276c4367 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:17.159282 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7c9fb-e885-4e59-829e-5b4c276c4367 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:17.159555 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7c9fb-e885-4e59-829e-5b4c276c4367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:17.182260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-22e7c9fb-e885-4e59-829e-5b4c276c4367 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:17.184106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-22e7c9fb-e885-4e59-829e-5b4c276c4367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:17.228587 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1720cee-a704-405b-9881-92a3ec139bb2 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:17.257744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:17.267026 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a85df-2ae5-48a3-9bad-c2d3e0e01e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:17.267716 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a85df-2ae5-48a3-9bad-c2d3e0e01e52 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:17.268064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a85df-2ae5-48a3-9bad-c2d3e0e01e52 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:17.268403 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a85df-2ae5-48a3-9bad-c2d3e0e01e52 None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:17.269114 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a85df-2ae5-48a3-9bad-c2d3e0e01e52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:17.269503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a85df-2ae5-48a3-9bad-c2d3e0e01e52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:17.271164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a85df-2ae5-48a3-9bad-c2d3e0e01e52 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:17.282704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 354/723] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:17 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:13:17.293741 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 370/724] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:17.295784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7c9fb-e885-4e59-829e-5b4c276c4367 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:17.364530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:17.425807 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7c9fb-e885-4e59-829e-5b4c276c4367 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:17.464403 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c0ef5-3fc2-45a4-9fd8-180bb3c9fbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:17.465034 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c0ef5-3fc2-45a4-9fd8-180bb3c9fbd0 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:17.465310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c0ef5-3fc2-45a4-9fd8-180bb3c9fbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:17.465580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c0ef5-3fc2-45a4-9fd8-180bb3c9fbd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:17.472637 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c0ef5-3fc2-45a4-9fd8-180bb3c9fbd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:17.474079 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c0ef5-3fc2-45a4-9fd8-180bb3c9fbd0 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:17.485434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-699c0ef5-3fc2-45a4-9fd8-180bb3c9fbd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:13:17.485434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:17.485434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:17.485434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:17.485434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:17.485434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:17.485434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:17.485434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:17.485434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:17.485434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:17.485434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:17.485434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:17.485434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:13:17.485434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:13:17.485434 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:13:17.486353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:13:17.486353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:17.486353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:17.486353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:17.486353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:17.486353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:17.486353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:17.486353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:17.486353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:17.486353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:17.486353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:17.486353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:17.486353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:17.486353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:17.486353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:17.486353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:17.486353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:17.487272 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:13:17.487272 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:13:17.487272 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:13:17.487272 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:13:17.487272 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:13:17.487272 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:13:17.487272 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:13:17.487272 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:17.487272 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 355/725] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:13:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:17.492627 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a85df-2ae5-48a3-9bad-c2d3e0e01e52 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:17.603020 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a85df-2ae5-48a3-9bad-c2d3e0e01e52 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:17.638947 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2ace1-2c0f-4203-b378-8d75d144aa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:17.639472 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2ace1-2c0f-4203-b378-8d75d144aa9a None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:17.639749 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2ace1-2c0f-4203-b378-8d75d144aa9a None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:17.640015 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2ace1-2c0f-4203-b378-8d75d144aa9a None admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:17.640699 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2ace1-2c0f-4203-b378-8d75d144aa9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:17.641001 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2ace1-2c0f-4203-b378-8d75d144aa9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:17.642502 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2ace1-2c0f-4203-b378-8d75d144aa9a None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:17.655417 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 371/726] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:13:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:17.664545 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c0ef5-3fc2-45a4-9fd8-180bb3c9fbd0 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:17.670819 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2ace1-2c0f-4203-b378-8d75d144aa9a None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:17.720861 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:17.773670 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c0ef5-3fc2-45a4-9fd8-180bb3c9fbd0 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:17.776754 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2ace1-2c0f-4203-b378-8d75d144aa9a None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:17.781813 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:17.810474 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6724f74-0988-4562-9a2a-5f8ae37c5c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:17.811143 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6724f74-0988-4562-9a2a-5f8ae37c5c89 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:17.811527 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6724f74-0988-4562-9a2a-5f8ae37c5c89 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:17.812952 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6724f74-0988-4562-9a2a-5f8ae37c5c89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:17.813823 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6724f74-0988-4562-9a2a-5f8ae37c5c89 None admin] RBAC: Adding query filter params (role.id=8fdfbc4aaf68468f89a5ae3450b8488d, scope.project.id=409a043500554125a93c4636db5a6812, user.id=54c899e786614c18b2bf4334ceb2f891) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:17.814140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6724f74-0988-4562-9a2a-5f8ae37c5c89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:17.814477 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc26e15-f589-4dab-a01d-aac76b34bc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:17.815171 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc26e15-f589-4dab-a01d-aac76b34bc37 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:17.815448 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc26e15-f589-4dab-a01d-aac76b34bc37 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:17.815640 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6724f74-0988-4562-9a2a-5f8ae37c5c89 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:17.815799 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc26e15-f589-4dab-a01d-aac76b34bc37 None admin] PATH_INFO: `/v3/services/image` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:17.816562 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc26e15-f589-4dab-a01d-aac76b34bc37 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:17.817960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc26e15-f589-4dab-a01d-aac76b34bc37 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:17.823827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 356/727] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:13:17 2022] GET /identity/v3/role_assignments?user.id=54c899e786614c18b2bf4334ceb2f891&scope.project.id=409a043500554125a93c4636db5a6812&role.id=8fdfbc4aaf68468f89a5ae3450b8488d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:17.831479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-efc26e15-f589-4dab-a01d-aac76b34bc37 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 19:13:17.831479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:17.831479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:13:17.831479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:13:17.831479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:13:17.831479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:13:17.831479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:13:17.831479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:17.831479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 19:13:17.831479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:17.831479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:17.831479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:17.831479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:17.831479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:17.831479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:17.831479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:17.831479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:17.833939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:17.833939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:17.833939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:17.833939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:17.833939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:17.833939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:17.833939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:13:17.833939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:13:17.833939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:13:17.833939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:13:17.833939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:17.833939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:17.833939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:17.833939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:17.833939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:17.833939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:17.836583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:17.836583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:17.836583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:17.836583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:17.836583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:17.836583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:17.836583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:17.836583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:17.836583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:17.836583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:17.836583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:13:17.836583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:17.836583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 19:13:17.836583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:17.836583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 372/728] 10.222.0.61 () {56 vars in 1105 bytes} [Fri Aug 19 19:13:17 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:17.846600 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6724f74-0988-4562-9a2a-5f8ae37c5c89 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:17.961865 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6724f74-0988-4562-9a2a-5f8ae37c5c89 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:17.992830 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff81af-3844-47ac-b327-1b099a0d9ed3 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:17.993151 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff81af-3844-47ac-b327-1b099a0d9ed3 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:17.993378 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff81af-3844-47ac-b327-1b099a0d9ed3 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:17.995330 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 373/729] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:18.001982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bd523-8a80-454b-9c57-c19882c0fcd8 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:18.002398 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bd523-8a80-454b-9c57-c19882c0fcd8 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:18.002793 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bd523-8a80-454b-9c57-c19882c0fcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:18.005233 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319900cf-8076-4e95-b4b6-8d8919236e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:18.006047 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319900cf-8076-4e95-b4b6-8d8919236e99 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:18.006478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319900cf-8076-4e95-b4b6-8d8919236e99 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:18.007026 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319900cf-8076-4e95-b4b6-8d8919236e99 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:18.007804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319900cf-8076-4e95-b4b6-8d8919236e99 None admin] RBAC: Adding query filter params (name=image) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:18.008247 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319900cf-8076-4e95-b4b6-8d8919236e99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:18.009752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319900cf-8076-4e95-b4b6-8d8919236e99 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:18.015358 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 357/730] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:18.021183 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319900cf-8076-4e95-b4b6-8d8919236e99 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:18.035725 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-a26bd523-8a80-454b-9c57-c19882c0fcd8 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:18.036936 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-a26bd523-8a80-454b-9c57-c19882c0fcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:18.060906 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:18.127848 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 374/731] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:18 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:13:18.144830 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319900cf-8076-4e95-b4b6-8d8919236e99 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:18.182018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70662d9-5076-4b12-90aa-90bd35fd78a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:18.182696 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70662d9-5076-4b12-90aa-90bd35fd78a6 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:18.182987 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70662d9-5076-4b12-90aa-90bd35fd78a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:18.183376 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70662d9-5076-4b12-90aa-90bd35fd78a6 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:18.184012 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70662d9-5076-4b12-90aa-90bd35fd78a6 None admin] RBAC: Adding query filter params (type=image) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:18.184319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70662d9-5076-4b12-90aa-90bd35fd78a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:18.185700 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70662d9-5076-4b12-90aa-90bd35fd78a6 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:18.196520 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 358/732] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:18.203653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bd523-8a80-454b-9c57-c19882c0fcd8 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:18.245721 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:18.310005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bd523-8a80-454b-9c57-c19882c0fcd8 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:18.345745 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824bf03-8fdd-4f95-8921-b909649a4614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:18.346352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824bf03-8fdd-4f95-8921-b909649a4614 None admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:18.346660 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824bf03-8fdd-4f95-8921-b909649a4614 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:18.346929 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824bf03-8fdd-4f95-8921-b909649a4614 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:18.347581 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824bf03-8fdd-4f95-8921-b909649a4614 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:18.349048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824bf03-8fdd-4f95-8921-b909649a4614 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:18.463913 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 375/733] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Aug 19 19:13:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:13:18.471948 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70662d9-5076-4b12-90aa-90bd35fd78a6 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:18.583139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:18.588227 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70662d9-5076-4b12-90aa-90bd35fd78a6 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:18.588596 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6646f-710f-4429-8a10-eb570f6a6fb6 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:18.588887 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6646f-710f-4429-8a10-eb570f6a6fb6 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:18.589181 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6646f-710f-4429-8a10-eb570f6a6fb6 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:18.590857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 376/734] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:18.597008 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313a772-b2b5-40bb-baa4-d20e2e88a991 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:18.597008 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313a772-b2b5-40bb-baa4-d20e2e88a991 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:18.597008 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313a772-b2b5-40bb-baa4-d20e2e88a991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:18.617984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-a313a772-b2b5-40bb-baa4-d20e2e88a991 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:18.619304 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-a313a772-b2b5-40bb-baa4-d20e2e88a991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:18.635702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb811340-56b3-4229-b3c3-5f42d1282542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:18.636658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb811340-56b3-4229-b3c3-5f42d1282542 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:18.637106 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb811340-56b3-4229-b3c3-5f42d1282542 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:18.637639 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb811340-56b3-4229-b3c3-5f42d1282542 None admin] PATH_INFO: `/v3/services/network` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:18.638485 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb811340-56b3-4229-b3c3-5f42d1282542 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:18.640469 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb811340-56b3-4229-b3c3-5f42d1282542 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:18.652018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-fb811340-56b3-4229-b3c3-5f42d1282542 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 19:13:18.652018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:18.652018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:13:18.652018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:13:18.652018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:13:18.652018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:13:18.652018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:13:18.652018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:18.652018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 19:13:18.652018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:18.652018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:18.652018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:18.652018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:18.652018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:18.652018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:18.652018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:18.652018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:18.653096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:18.653096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:18.653096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:18.653096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:18.653096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:18.653096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:18.653096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:13:18.653096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:13:18.653096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:13:18.653096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:13:18.653096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:18.653096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:18.653096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:18.653096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:18.653096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:18.653096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:18.653910 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:18.653910 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:18.653910 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:18.653910 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:18.653910 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:18.653910 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:18.653910 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:18.653910 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:18.653910 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:18.653910 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:18.653910 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:13:18.653910 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:18.653910 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 19:13:18.653910 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:18.656714 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 359/735] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:13:18 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:18.662253 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb811340-56b3-4229-b3c3-5f42d1282542 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:18.703925 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 377/736] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:18 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 19:13:18.790594 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb811340-56b3-4229-b3c3-5f42d1282542 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:18.826034 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304a25e-56dd-4795-8106-d5e5a53b3b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:18.826586 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304a25e-56dd-4795-8106-d5e5a53b3b6e None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:18.826918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304a25e-56dd-4795-8106-d5e5a53b3b6e None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:18.827198 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304a25e-56dd-4795-8106-d5e5a53b3b6e None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:18.827820 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304a25e-56dd-4795-8106-d5e5a53b3b6e None admin] RBAC: Adding query filter params (name=network) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:18.828121 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304a25e-56dd-4795-8106-d5e5a53b3b6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:18.829490 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304a25e-56dd-4795-8106-d5e5a53b3b6e None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:18.834549 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 360/737] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Aug 19 19:13:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:18.840869 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313a772-b2b5-40bb-baa4-d20e2e88a991 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:18.869552 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:18.948124 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313a772-b2b5-40bb-baa4-d20e2e88a991 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:18.984849 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d76ac0-ecc7-4b8d-898e-7b92501bfef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:18.985453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d76ac0-ecc7-4b8d-898e-7b92501bfef8 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:18.985729 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d76ac0-ecc7-4b8d-898e-7b92501bfef8 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:18.985995 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d76ac0-ecc7-4b8d-898e-7b92501bfef8 None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:18.986646 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d76ac0-ecc7-4b8d-898e-7b92501bfef8 None admin] RBAC: Adding query filter params (type=network) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:18.986944 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d76ac0-ecc7-4b8d-898e-7b92501bfef8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:18.988299 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d76ac0-ecc7-4b8d-898e-7b92501bfef8 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:18.994123 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 378/738] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Aug 19 19:13:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:13:18.999951 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304a25e-56dd-4795-8106-d5e5a53b3b6e None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:19.032190 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:19.073318 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d76ac0-ecc7-4b8d-898e-7b92501bfef8 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:19.127009 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304a25e-56dd-4795-8106-d5e5a53b3b6e None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:19.171468 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70b78b-d3ab-490f-adc3-7c25176da04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:19.172230 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70b78b-d3ab-490f-adc3-7c25176da04d None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:19.172605 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70b78b-d3ab-490f-adc3-7c25176da04d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:19.172978 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70b78b-d3ab-490f-adc3-7c25176da04d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:19.173760 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70b78b-d3ab-490f-adc3-7c25176da04d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:19.175288 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70b78b-d3ab-490f-adc3-7c25176da04d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:19.187911 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:19.199502 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d76ac0-ecc7-4b8d-898e-7b92501bfef8 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:19.235401 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466dfe4-a94c-4ed8-9753-a335d9ec02d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:19.236061 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466dfe4-a94c-4ed8-9753-a335d9ec02d3 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:19.236382 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466dfe4-a94c-4ed8-9753-a335d9ec02d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:19.236656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466dfe4-a94c-4ed8-9753-a335d9ec02d3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:19.237285 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466dfe4-a94c-4ed8-9753-a335d9ec02d3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:19.238714 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466dfe4-a94c-4ed8-9753-a335d9ec02d3 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:19.248484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-a466dfe4-a94c-4ed8-9753-a335d9ec02d3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 19:13:19.248484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:19.248484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:13:19.248484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:13:19.248484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:13:19.248484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:13:19.248484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:13:19.248484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:19.248484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 19:13:19.248484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:19.248484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:19.248484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:19.248484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:19.248484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:19.248484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:19.248484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:19.248484 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:19.249437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:19.249437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:19.249437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:19.249437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:19.249437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:19.249437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:19.249437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:13:19.249437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:13:19.249437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:13:19.249437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:13:19.249437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:19.249437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:19.249437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:19.249437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:19.249437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:19.249437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:19.251391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:19.251391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:19.251391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:19.251391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:19.251391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:19.251391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:19.251391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:19.251391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:19.251391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:19.251391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:19.251391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:13:19.251391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:19.251391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 19:13:19.251391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:19.251391 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 379/739] 10.222.0.61 () {56 vars in 1129 bytes} [Fri Aug 19 19:13:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:13:19.255774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466dfe4-a94c-4ed8-9753-a335d9ec02d3 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:19.269068 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 361/740] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Aug 19 19:13:18 2022] POST /identity/v3/endpoints => generated 337 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:13:19.387923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466dfe4-a94c-4ed8-9753-a335d9ec02d3 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:19.435671 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac36280-de5f-434b-a281-e1dc9ce14cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:19.436581 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac36280-de5f-434b-a281-e1dc9ce14cb8 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:19.437068 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac36280-de5f-434b-a281-e1dc9ce14cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:19.437508 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac36280-de5f-434b-a281-e1dc9ce14cb8 None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:19.438311 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac36280-de5f-434b-a281-e1dc9ce14cb8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:19.438811 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac36280-de5f-434b-a281-e1dc9ce14cb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:19.440477 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac36280-de5f-434b-a281-e1dc9ce14cb8 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:19.447251 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 380/741] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Aug 19 19:13:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:19.454612 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70b78b-d3ab-490f-adc3-7c25176da04d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:19.547660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:19.577473 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70b78b-d3ab-490f-adc3-7c25176da04d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:19.614153 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9af7cc-782b-4286-bae5-fc3afc68aa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:19.614872 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9af7cc-782b-4286-bae5-fc3afc68aa52 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:19.615151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9af7cc-782b-4286-bae5-fc3afc68aa52 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:19.615426 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9af7cc-782b-4286-bae5-fc3afc68aa52 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:19.617220 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9af7cc-782b-4286-bae5-fc3afc68aa52 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:19.617538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9af7cc-782b-4286-bae5-fc3afc68aa52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:19.618956 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9af7cc-782b-4286-bae5-fc3afc68aa52 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:19.626678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 362/742] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Aug 19 19:13:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:19.630001 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac36280-de5f-434b-a281-e1dc9ce14cb8 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:19.649267 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:19.737157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac36280-de5f-434b-a281-e1dc9ce14cb8 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:19.774905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d5bee-c733-469a-ac44-a06cbb841405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:19.775520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d5bee-c733-469a-ac44-a06cbb841405 None admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:19.775798 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d5bee-c733-469a-ac44-a06cbb841405 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:19.776068 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d5bee-c733-469a-ac44-a06cbb841405 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:19.776723 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d5bee-c733-469a-ac44-a06cbb841405 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:19.778088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d5bee-c733-469a-ac44-a06cbb841405 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:19.882569 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 381/743] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Aug 19 19:13:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:13:20.147642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb3ba5-57af-44f9-93a5-ca541c02d41e None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:20.148158 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb3ba5-57af-44f9-93a5-ca541c02d41e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:20.148264 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb3ba5-57af-44f9-93a5-ca541c02d41e None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:20.149661 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 363/744] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:20.154671 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd37b7-0f71-4b11-a776-e67a5890da09 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:20.154960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd37b7-0f71-4b11-a776-e67a5890da09 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:20.155231 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd37b7-0f71-4b11-a776-e67a5890da09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:20.172942 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-f3cd37b7-0f71-4b11-a776-e67a5890da09 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:20.174118 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-f3cd37b7-0f71-4b11-a776-e67a5890da09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:20.236166 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:20.246382 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 382/745] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:20 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:13:20.569530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb3ba5-57af-44f9-93a5-ca541c02d41e None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:20.672497 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb3ba5-57af-44f9-93a5-ca541c02d41e None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:20.706119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb13eda-6008-4f43-84dd-e66f5375ee52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:20.706774 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb13eda-6008-4f43-84dd-e66f5375ee52 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:20.707050 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb13eda-6008-4f43-84dd-e66f5375ee52 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:20.707318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb13eda-6008-4f43-84dd-e66f5375ee52 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:20.707890 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb13eda-6008-4f43-84dd-e66f5375ee52 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:20.709251 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb13eda-6008-4f43-84dd-e66f5375ee52 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:20.717981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-2fb13eda-6008-4f43-84dd-e66f5375ee52 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 19:13:20.717981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:20.717981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:13:20.717981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:13:20.717981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:13:20.717981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:13:20.717981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:13:20.717981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:20.717981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 19:13:20.717981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:20.717981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:20.717981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:20.717981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:20.717981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:20.717981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:20.717981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:20.719156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:20.719156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:20.719156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:20.719156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:20.719156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:20.719156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:20.719156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:20.719156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:13:20.719156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:13:20.719156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:13:20.719156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:13:20.719156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:20.719156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:20.719156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:20.719156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:20.719156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:20.719156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:20.720066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:20.720066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:20.720066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:20.720066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:20.720066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:20.720066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:20.720066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:20.720066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:20.720066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:20.720066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:20.720066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:13:20.720066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:20.720066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 19:13:20.720066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:20.721378 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 364/746] 10.222.0.61 () {56 vars in 1132 bytes} [Fri Aug 19 19:13:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:20.725680 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd37b7-0f71-4b11-a776-e67a5890da09 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:20.829778 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd37b7-0f71-4b11-a776-e67a5890da09 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:20.864562 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45792727-1566-4c65-9058-91cec06e6404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:20.865161 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45792727-1566-4c65-9058-91cec06e6404 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:20.865453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45792727-1566-4c65-9058-91cec06e6404 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:20.866684 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45792727-1566-4c65-9058-91cec06e6404 None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:20.866684 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45792727-1566-4c65-9058-91cec06e6404 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:20.866936 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45792727-1566-4c65-9058-91cec06e6404 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:20.869965 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45792727-1566-4c65-9058-91cec06e6404 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:20.874159 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 383/747] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Aug 19 19:13:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:20.879606 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb13eda-6008-4f43-84dd-e66f5375ee52 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:20.889297 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:20.900385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea6d56-b567-4719-9a5c-47fcb6c5cd86 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:20.900727 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea6d56-b567-4719-9a5c-47fcb6c5cd86 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:20.901003 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea6d56-b567-4719-9a5c-47fcb6c5cd86 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:20.902470 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 384/748] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:13:20.907704 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8068e5-7cdd-46e3-9ebf-73841b767c8f None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:20.908000 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8068e5-7cdd-46e3-9ebf-73841b767c8f None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:20.908579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8068e5-7cdd-46e3-9ebf-73841b767c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:20.926849 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-3b8068e5-7cdd-46e3-9ebf-73841b767c8f None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:20.928098 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-3b8068e5-7cdd-46e3-9ebf-73841b767c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:20.991206 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:20.992261 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb13eda-6008-4f43-84dd-e66f5375ee52 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:21.005803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 385/749] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:20 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 19:13:21.034817 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1602-79ac-47c0-8a58-fe0eb3117e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:21.035775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1602-79ac-47c0-8a58-fe0eb3117e10 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:21.036291 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1602-79ac-47c0-8a58-fe0eb3117e10 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:21.036753 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1602-79ac-47c0-8a58-fe0eb3117e10 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:21.037645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d1602-79ac-47c0-8a58-fe0eb3117e10 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:21.038830 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d1602-79ac-47c0-8a58-fe0eb3117e10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:21.040386 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d1602-79ac-47c0-8a58-fe0eb3117e10 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:21.045286 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 365/750] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Aug 19 19:13:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:13:21.343133 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8068e5-7cdd-46e3-9ebf-73841b767c8f None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:21.448864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8068e5-7cdd-46e3-9ebf-73841b767c8f None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:21.483409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f50ac5-1bac-4907-8b88-466bd371b076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:21.484017 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f50ac5-1bac-4907-8b88-466bd371b076 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:21.484299 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f50ac5-1bac-4907-8b88-466bd371b076 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:21.484570 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f50ac5-1bac-4907-8b88-466bd371b076 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:21.544084 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:21.555316 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f50ac5-1bac-4907-8b88-466bd371b076 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:21.556810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f50ac5-1bac-4907-8b88-466bd371b076 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:21.666632 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 386/751] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:13:21 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 19:13:21.668582 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1602-79ac-47c0-8a58-fe0eb3117e10 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:21.742359 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:21.774061 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1602-79ac-47c0-8a58-fe0eb3117e10 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:21.808749 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898f213-1ff1-4743-a32f-350478f943d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:21.809381 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898f213-1ff1-4743-a32f-350478f943d5 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:21.809853 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898f213-1ff1-4743-a32f-350478f943d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:21.809958 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898f213-1ff1-4743-a32f-350478f943d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:21.822115 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898f213-1ff1-4743-a32f-350478f943d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:21.823607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898f213-1ff1-4743-a32f-350478f943d5 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:21.847082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-b898f213-1ff1-4743-a32f-350478f943d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:21.847082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:21.847082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:21.847082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:21.847082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:21.847082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:21.847082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:21.847082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:21.847082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:21.847082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:21.847082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:21.847082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:21.847082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:13:21.847082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:13:21.847082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:13:21.847082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:13:21.848110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:21.848110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:21.848110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:21.848110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:21.848110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:21.848110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:21.848110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:21.848110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:21.848110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:21.848110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:21.848110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:21.848110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:21.848110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:21.848110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:21.848110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:21.848110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:21.848110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:13:21.849378 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:13:21.849378 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:13:21.849378 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:21.850952 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 366/752] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:21.856056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f50ac5-1bac-4907-8b88-466bd371b076 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:21.971170 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:21.981791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f50ac5-1bac-4907-8b88-466bd371b076 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:22.018317 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b5493-07b3-4d91-b746-3bbccdc66732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:22.018963 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b5493-07b3-4d91-b746-3bbccdc66732 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:22.019247 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b5493-07b3-4d91-b746-3bbccdc66732 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:22.019518 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b5493-07b3-4d91-b746-3bbccdc66732 None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:22.020154 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b5493-07b3-4d91-b746-3bbccdc66732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:22.020457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b5493-07b3-4d91-b746-3bbccdc66732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:22.021886 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b5493-07b3-4d91-b746-3bbccdc66732 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:22.034002 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 387/753] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:22.237057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffd71a-02fe-4ae5-8739-1987d0e45975 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:22.237253 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffd71a-02fe-4ae5-8739-1987d0e45975 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:22.237528 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffd71a-02fe-4ae5-8739-1987d0e45975 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:22.239181 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 367/754] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:22.245334 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19263501-975b-4f41-991b-c55cedc8415d None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:22.245593 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19263501-975b-4f41-991b-c55cedc8415d None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:22.245867 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19263501-975b-4f41-991b-c55cedc8415d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:22.264099 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-19263501-975b-4f41-991b-c55cedc8415d None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:22.265286 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-19263501-975b-4f41-991b-c55cedc8415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:22.338601 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 388/755] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:22 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:13:22.666589 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffd71a-02fe-4ae5-8739-1987d0e45975 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:22.893720 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffd71a-02fe-4ae5-8739-1987d0e45975 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:22.916210 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:22.926761 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319c457-48e5-4256-a2eb-f21ef6810c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:22.927393 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319c457-48e5-4256-a2eb-f21ef6810c41 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:22.927662 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319c457-48e5-4256-a2eb-f21ef6810c41 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:22.934693 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319c457-48e5-4256-a2eb-f21ef6810c41 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:22.934693 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319c457-48e5-4256-a2eb-f21ef6810c41 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:22.934693 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319c457-48e5-4256-a2eb-f21ef6810c41 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:22.938310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-e319c457-48e5-4256-a2eb-f21ef6810c41 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 19:13:22.938310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:22.938310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:13:22.938310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:13:22.938310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:13:22.938310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:13:22.938310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:13:22.938310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:22.938310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 19:13:22.938310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:22.938310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:22.938310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:22.938310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:22.938310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:22.938310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:22.938310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:22.938310 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:22.939319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:22.939319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:22.939319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:22.939319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:22.939319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:22.939319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:22.939319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:13:22.939319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:13:22.939319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:13:22.939319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:13:22.939319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:22.939319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:22.939319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:22.939319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:22.939319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:22.939319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:22.940182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:22.940182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:22.940182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:22.940182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:22.940182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:22.940182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:22.940182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:22.940182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:22.940182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:22.940182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:22.940182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:13:22.940182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:22.940182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 19:13:22.940182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:22.940182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 368/756] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:13:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:22.946217 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19263501-975b-4f41-991b-c55cedc8415d None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:23.025874 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:23.044653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19263501-975b-4f41-991b-c55cedc8415d None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:23.079588 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b479ce-3040-4f45-8620-6f5cb5bfa146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:23.080186 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b479ce-3040-4f45-8620-6f5cb5bfa146 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:23.080459 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b479ce-3040-4f45-8620-6f5cb5bfa146 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:23.080726 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b479ce-3040-4f45-8620-6f5cb5bfa146 None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:23.081346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b479ce-3040-4f45-8620-6f5cb5bfa146 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:23.081644 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b479ce-3040-4f45-8620-6f5cb5bfa146 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:23.083036 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b479ce-3040-4f45-8620-6f5cb5bfa146 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:23.087570 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 389/757] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:13:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:23.093313 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319c457-48e5-4256-a2eb-f21ef6810c41 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:23.210868 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319c457-48e5-4256-a2eb-f21ef6810c41 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:23.244301 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b55cd3-7893-4272-8508-6dd99cfd903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:23.244891 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b55cd3-7893-4272-8508-6dd99cfd903c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:23.245162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b55cd3-7893-4272-8508-6dd99cfd903c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:23.245426 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b55cd3-7893-4272-8508-6dd99cfd903c None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:23.246044 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b55cd3-7893-4272-8508-6dd99cfd903c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:23.246337 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b55cd3-7893-4272-8508-6dd99cfd903c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:23.247723 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b55cd3-7893-4272-8508-6dd99cfd903c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:23.252264 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 369/758] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:13:23 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:23.317751 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58f6f8-3d86-430c-8e74-c3fa8c500109 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:23.318144 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58f6f8-3d86-430c-8e74-c3fa8c500109 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:23.318486 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58f6f8-3d86-430c-8e74-c3fa8c500109 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:23.320938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 390/759] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:23.326779 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86575a57-37fe-40aa-ad4a-fd87a11442c1 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:23.327065 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86575a57-37fe-40aa-ad4a-fd87a11442c1 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:23.327341 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86575a57-37fe-40aa-ad4a-fd87a11442c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:23.347137 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-86575a57-37fe-40aa-ad4a-fd87a11442c1 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:23.348362 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-86575a57-37fe-40aa-ad4a-fd87a11442c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:23.400375 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:23.421544 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 370/760] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:23 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:13:23.747604 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58f6f8-3d86-430c-8e74-c3fa8c500109 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:23.847785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58f6f8-3d86-430c-8e74-c3fa8c500109 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:23.880336 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dbfc8-8ec9-4c81-903d-ffdadbc54c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:23.880925 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dbfc8-8ec9-4c81-903d-ffdadbc54c72 None admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:23.881888 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dbfc8-8ec9-4c81-903d-ffdadbc54c72 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:23.882160 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dbfc8-8ec9-4c81-903d-ffdadbc54c72 None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:23.882823 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824dbfc8-8ec9-4c81-903d-ffdadbc54c72 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:23.884177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824dbfc8-8ec9-4c81-903d-ffdadbc54c72 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:23.958929 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 391/761] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Aug 19 19:13:23 2022] POST /identity/v3/services => generated 269 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:13:25.437474 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75f325-3baa-4f06-9af4-0f8a57c54e57 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:25.438112 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75f325-3baa-4f06-9af4-0f8a57c54e57 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:25.438112 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75f325-3baa-4f06-9af4-0f8a57c54e57 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:25.439458 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 371/762] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:25.445875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf759f-968f-45e5-88b2-ade5739fd2ba None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:25.446328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf759f-968f-45e5-88b2-ade5739fd2ba None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:25.446425 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf759f-968f-45e5-88b2-ade5739fd2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:25.453614 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:25.464659 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-7adf759f-968f-45e5-88b2-ade5739fd2ba None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:25.465850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-7adf759f-968f-45e5-88b2-ade5739fd2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:25.539060 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 392/763] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:25 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:13:25.864699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75f325-3baa-4f06-9af4-0f8a57c54e57 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:25.971617 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75f325-3baa-4f06-9af4-0f8a57c54e57 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:26.004446 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bcfb1-9a48-47bb-9dbb-7a58db392554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:26.005042 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bcfb1-9a48-47bb-9dbb-7a58db392554 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:26.005312 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bcfb1-9a48-47bb-9dbb-7a58db392554 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:26.005575 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bcfb1-9a48-47bb-9dbb-7a58db392554 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:26.006768 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bcfb1-9a48-47bb-9dbb-7a58db392554 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:26.008222 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bcfb1-9a48-47bb-9dbb-7a58db392554 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:26.102113 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 372/764] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Aug 19 19:13:25 2022] POST /identity/v3/services => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:13:26.178858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c22c2-5fc4-4a17-b568-1a01316ce7ae None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:26.179076 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c22c2-5fc4-4a17-b568-1a01316ce7ae None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:26.179314 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c22c2-5fc4-4a17-b568-1a01316ce7ae None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:26.180687 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 393/765] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:26.186572 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de6f61-ba61-4027-82ab-0836250e269f None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:26.186862 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de6f61-ba61-4027-82ab-0836250e269f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:26.187164 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de6f61-ba61-4027-82ab-0836250e269f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:26.207067 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c1de6f61-ba61-4027-82ab-0836250e269f None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:26.208324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c1de6f61-ba61-4027-82ab-0836250e269f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:26.245635 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:26.286974 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 373/766] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:26 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:13:26.617692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c22c2-5fc4-4a17-b568-1a01316ce7ae None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:26.721657 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c22c2-5fc4-4a17-b568-1a01316ce7ae None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:26.750552 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:26.756756 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e386db-d02e-4209-be89-eb9e579eb076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:26.757462 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e386db-d02e-4209-be89-eb9e579eb076 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:26.761882 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e386db-d02e-4209-be89-eb9e579eb076 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:26.761882 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e386db-d02e-4209-be89-eb9e579eb076 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:26.761882 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e386db-d02e-4209-be89-eb9e579eb076 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:26.761882 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e386db-d02e-4209-be89-eb9e579eb076 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:26.768734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-f8e386db-d02e-4209-be89-eb9e579eb076 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 19:13:26.768734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:26.768734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:13:26.768734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:13:26.768734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:13:26.768734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:13:26.768734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:13:26.768734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:26.768734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 19:13:26.768734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:26.768734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:26.768734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:26.768734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:26.768734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:26.768734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:26.768734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:26.769875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:26.769875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:26.769875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:26.769875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:26.769875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:26.769875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:26.769875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:26.769875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:13:26.769875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:13:26.769875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:13:26.769875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:13:26.769875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:26.769875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:26.769875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:26.769875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:26.769875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:26.769875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:26.770917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:26.770917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:26.770917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:26.770917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:26.770917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:26.770917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:26.770917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:26.770917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:26.770917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:26.770917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:26.770917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:13:26.770917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:26.770917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 19:13:26.770917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:26.770917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 394/767] 10.222.0.61 () {56 vars in 1132 bytes} [Fri Aug 19 19:13:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:26.776299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de6f61-ba61-4027-82ab-0836250e269f None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:26.873321 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de6f61-ba61-4027-82ab-0836250e269f None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:26.907641 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff011338-fb0b-4c75-bf87-7d0f7fb115d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:26.908241 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff011338-fb0b-4c75-bf87-7d0f7fb115d3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:26.908517 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff011338-fb0b-4c75-bf87-7d0f7fb115d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:26.908783 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff011338-fb0b-4c75-bf87-7d0f7fb115d3 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:26.909397 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff011338-fb0b-4c75-bf87-7d0f7fb115d3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:26.909712 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff011338-fb0b-4c75-bf87-7d0f7fb115d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:26.911183 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff011338-fb0b-4c75-bf87-7d0f7fb115d3 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:26.919417 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 374/768] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Aug 19 19:13:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:26.925071 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e386db-d02e-4209-be89-eb9e579eb076 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:27.023421 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e386db-d02e-4209-be89-eb9e579eb076 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:27.056494 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab802931-f131-4cf4-a210-bba6b2c9ce45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:27.057086 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab802931-f131-4cf4-a210-bba6b2c9ce45 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:27.057359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab802931-f131-4cf4-a210-bba6b2c9ce45 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:27.057623 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab802931-f131-4cf4-a210-bba6b2c9ce45 None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:27.058240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab802931-f131-4cf4-a210-bba6b2c9ce45 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:27.058560 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab802931-f131-4cf4-a210-bba6b2c9ce45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:27.059914 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab802931-f131-4cf4-a210-bba6b2c9ce45 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:27.064573 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 395/769] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Aug 19 19:13:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:27.070967 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff011338-fb0b-4c75-bf87-7d0f7fb115d3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:27.100801 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:27.171302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff011338-fb0b-4c75-bf87-7d0f7fb115d3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:27.207408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9a3fa-959c-4e2d-8795-9d339de7777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:27.208011 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9a3fa-959c-4e2d-8795-9d339de7777c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:27.208283 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9a3fa-959c-4e2d-8795-9d339de7777c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:27.208552 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9a3fa-959c-4e2d-8795-9d339de7777c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:27.209294 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9a3fa-959c-4e2d-8795-9d339de7777c None admin] RBAC: Adding query filter params (interface=public, service_id=976bae4dcef748b5a605deb8d894c44b, region_id=RegionOne) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:27.209598 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9a3fa-959c-4e2d-8795-9d339de7777c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:27.211003 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9a3fa-959c-4e2d-8795-9d339de7777c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:27.215970 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 375/770] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Aug 19 19:13:27 2022] GET /identity/v3/endpoints?service_id=976bae4dcef748b5a605deb8d894c44b&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:27.221827 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab802931-f131-4cf4-a210-bba6b2c9ce45 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:27.281544 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:27.324196 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab802931-f131-4cf4-a210-bba6b2c9ce45 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:27.357333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088022db-f6e0-416c-a753-c49fe574d93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:27.357931 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088022db-f6e0-416c-a753-c49fe574d93c None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:27.358209 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088022db-f6e0-416c-a753-c49fe574d93c None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:27.358476 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088022db-f6e0-416c-a753-c49fe574d93c None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:27.359163 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088022db-f6e0-416c-a753-c49fe574d93c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:27.360655 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088022db-f6e0-416c-a753-c49fe574d93c None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:27.367483 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 396/771] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Aug 19 19:13:27 2022] GET /identity/v3/services => generated 1498 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:13:28.325559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d2beb-d04b-4a1e-b6b0-997d830ea122 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:28.326122 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d2beb-d04b-4a1e-b6b0-997d830ea122 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:28.326122 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d2beb-d04b-4a1e-b6b0-997d830ea122 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:28.327463 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 376/772] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:28.332732 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b573a-2b89-4c04-993b-043fe3747ced None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:28.333130 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b573a-2b89-4c04-993b-043fe3747ced None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:28.333270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b573a-2b89-4c04-993b-043fe3747ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:28.351095 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-f96b573a-2b89-4c04-993b-043fe3747ced None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:28.352290 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-f96b573a-2b89-4c04-993b-043fe3747ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:28.418748 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 397/773] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:28 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:13:28.753255 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d2beb-d04b-4a1e-b6b0-997d830ea122 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:28.849280 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:28.857001 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d2beb-d04b-4a1e-b6b0-997d830ea122 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:28.890697 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad81ccb-e1ea-4e25-9151-21601a3df13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:28.891322 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad81ccb-e1ea-4e25-9151-21601a3df13c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:28.891601 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad81ccb-e1ea-4e25-9151-21601a3df13c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:28.891871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad81ccb-e1ea-4e25-9151-21601a3df13c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:28.892442 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad81ccb-e1ea-4e25-9151-21601a3df13c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:28.893798 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad81ccb-e1ea-4e25-9151-21601a3df13c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:28.902281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-8ad81ccb-e1ea-4e25-9151-21601a3df13c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 19:13:28.902281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:28.902281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:13:28.902281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:13:28.902281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:13:28.902281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:13:28.902281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:13:28.902281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:28.902281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 19:13:28.902281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:28.902281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:28.902281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:28.902281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:28.902281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:28.902281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:28.902281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:28.902281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:28.903342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:28.903342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:28.903342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:28.903342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:28.903342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:28.903342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:28.903342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:13:28.903342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:13:28.903342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:13:28.903342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:13:28.903342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:28.903342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:28.903342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:28.903342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:28.903342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:28.903342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:28.904211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:28.904211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:28.904211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:28.904211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:28.904211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:28.904211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:28.904211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:28.904211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:28.904211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:28.904211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:28.904211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:13:28.904211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:28.904211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 19:13:28.904211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:28.904211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 377/774] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:13:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:28.909498 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b573a-2b89-4c04-993b-043fe3747ced None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:28.961084 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:29.008529 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b573a-2b89-4c04-993b-043fe3747ced None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:29.042415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8d750-8edd-4f2c-a857-e60a5132e45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:29.043061 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8d750-8edd-4f2c-a857-e60a5132e45a None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:29.043317 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8d750-8edd-4f2c-a857-e60a5132e45a None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:29.043588 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8d750-8edd-4f2c-a857-e60a5132e45a None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:29.044206 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8d750-8edd-4f2c-a857-e60a5132e45a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:29.044505 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8d750-8edd-4f2c-a857-e60a5132e45a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:29.045858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8d750-8edd-4f2c-a857-e60a5132e45a None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:29.050406 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 398/775] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:13:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:29.057253 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad81ccb-e1ea-4e25-9151-21601a3df13c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:29.165880 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad81ccb-e1ea-4e25-9151-21601a3df13c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:29.201403 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9d849-d7df-4872-86b8-789dd80e5f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:29.202006 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9d849-d7df-4872-86b8-789dd80e5f3d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:29.202280 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9d849-d7df-4872-86b8-789dd80e5f3d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:29.202576 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9d849-d7df-4872-86b8-789dd80e5f3d None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:29.203196 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9d849-d7df-4872-86b8-789dd80e5f3d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:29.203495 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9d849-d7df-4872-86b8-789dd80e5f3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:29.204947 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9d849-d7df-4872-86b8-789dd80e5f3d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:29.209834 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 378/776] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:13:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:13:29.217571 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8d750-8edd-4f2c-a857-e60a5132e45a None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:29.315899 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8d750-8edd-4f2c-a857-e60a5132e45a None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:29.332559 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:29.349581 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36c1f1-3b43-4557-8503-de319d6eaa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:29.350286 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36c1f1-3b43-4557-8503-de319d6eaa48 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:29.350451 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36c1f1-3b43-4557-8503-de319d6eaa48 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:29.350749 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36c1f1-3b43-4557-8503-de319d6eaa48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:29.351444 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36c1f1-3b43-4557-8503-de319d6eaa48 None admin] RBAC: Adding query filter params (interface=public, service_id=4244378c98714427a564e8d5bdd4936e, region_id=RegionOne) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:29.351846 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36c1f1-3b43-4557-8503-de319d6eaa48 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:29.353935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36c1f1-3b43-4557-8503-de319d6eaa48 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:29.360869 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 399/777] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Aug 19 19:13:29 2022] GET /identity/v3/endpoints?service_id=4244378c98714427a564e8d5bdd4936e&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:29.367189 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9d849-d7df-4872-86b8-789dd80e5f3d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:29.392873 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:29.473048 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9d849-d7df-4872-86b8-789dd80e5f3d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:29.506799 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c447f-02a7-40e5-8586-9a11f5133c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:29.507400 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c447f-02a7-40e5-8586-9a11f5133c4c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:29.507674 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c447f-02a7-40e5-8586-9a11f5133c4c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:29.507941 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c447f-02a7-40e5-8586-9a11f5133c4c None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:29.508533 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c447f-02a7-40e5-8586-9a11f5133c4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:29.509887 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c447f-02a7-40e5-8586-9a11f5133c4c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:29.516000 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 379/778] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Aug 19 19:13:29 2022] GET /identity/v3/services => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:13:29.561156 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d64c4-c119-4e61-959b-e0d4a8ccc65a None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:29.561509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d64c4-c119-4e61-959b-e0d4a8ccc65a None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:29.561696 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d64c4-c119-4e61-959b-e0d4a8ccc65a None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:29.563106 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 400/779] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:29.568996 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777abf0-f05a-471f-b734-d9b042695533 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:29.569183 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777abf0-f05a-471f-b734-d9b042695533 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:29.569461 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777abf0-f05a-471f-b734-d9b042695533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:29.588639 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-8777abf0-f05a-471f-b734-d9b042695533 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:29.589872 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8777abf0-f05a-471f-b734-d9b042695533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:29.663292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 380/780] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:29 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:13:29.994515 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d64c4-c119-4e61-959b-e0d4a8ccc65a None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:30.094955 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d64c4-c119-4e61-959b-e0d4a8ccc65a None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:30.129571 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63a33c-fa0d-4bf9-a5a7-809595e2ffb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:30.130194 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63a33c-fa0d-4bf9-a5a7-809595e2ffb7 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:30.130471 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63a33c-fa0d-4bf9-a5a7-809595e2ffb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:30.131368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63a33c-fa0d-4bf9-a5a7-809595e2ffb7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:30.132040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63a33c-fa0d-4bf9-a5a7-809595e2ffb7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:30.133427 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63a33c-fa0d-4bf9-a5a7-809595e2ffb7 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:30.141945 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-fe63a33c-fa0d-4bf9-a5a7-809595e2ffb7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 19:13:30.141945 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:30.141945 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:13:30.141945 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:13:30.141945 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:13:30.141945 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:13:30.141945 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:13:30.141945 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:30.141945 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 19:13:30.141945 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:30.141945 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:30.141945 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:30.141945 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:30.141945 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:30.141945 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:30.141945 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:30.143048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:30.143048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:30.143048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:30.143048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:30.143048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:30.143048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:30.143048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:30.143048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:13:30.143048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:13:30.143048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:13:30.143048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:13:30.143048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:30.143048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:30.143048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:30.143048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:30.143048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:30.143048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:30.143938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:30.143938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:30.143938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:30.143938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:30.143938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:30.143938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:30.143938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:30.143938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:30.143938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:30.143938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:30.143938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:13:30.143938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:30.143938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 19:13:30.143938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:30.143938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 401/781] 10.222.0.61 () {56 vars in 1132 bytes} [Fri Aug 19 19:13:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:30.149548 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777abf0-f05a-471f-b734-d9b042695533 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:30.168123 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:30.252171 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777abf0-f05a-471f-b734-d9b042695533 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:30.288119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02186fdf-1de4-4df6-99e7-ddbe931a5cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:30.288712 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02186fdf-1de4-4df6-99e7-ddbe931a5cfe None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:30.288989 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02186fdf-1de4-4df6-99e7-ddbe931a5cfe None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:30.289258 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02186fdf-1de4-4df6-99e7-ddbe931a5cfe None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:30.289877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02186fdf-1de4-4df6-99e7-ddbe931a5cfe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:30.290180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02186fdf-1de4-4df6-99e7-ddbe931a5cfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:30.291727 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02186fdf-1de4-4df6-99e7-ddbe931a5cfe None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:30.296265 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 381/782] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Aug 19 19:13:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:30.302047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63a33c-fa0d-4bf9-a5a7-809595e2ffb7 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:30.348843 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:30.407408 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63a33c-fa0d-4bf9-a5a7-809595e2ffb7 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:30.439557 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5306b04-c796-4b12-9f26-ddc6a550f46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:30.440153 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5306b04-c796-4b12-9f26-ddc6a550f46f None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:30.440427 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5306b04-c796-4b12-9f26-ddc6a550f46f None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:30.440957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5306b04-c796-4b12-9f26-ddc6a550f46f None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:30.441571 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5306b04-c796-4b12-9f26-ddc6a550f46f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:30.441865 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5306b04-c796-4b12-9f26-ddc6a550f46f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:30.443871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5306b04-c796-4b12-9f26-ddc6a550f46f None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:30.448538 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 402/783] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Aug 19 19:13:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:30.454271 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02186fdf-1de4-4df6-99e7-ddbe931a5cfe None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:30.534156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:30.552281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02186fdf-1de4-4df6-99e7-ddbe931a5cfe None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:30.588456 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cb653-3928-4ca2-a5bc-973fbc4a2246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:30.589062 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cb653-3928-4ca2-a5bc-973fbc4a2246 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:30.589340 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cb653-3928-4ca2-a5bc-973fbc4a2246 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:30.589610 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cb653-3928-4ca2-a5bc-973fbc4a2246 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:30.590275 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cb653-3928-4ca2-a5bc-973fbc4a2246 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:30.591675 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cb653-3928-4ca2-a5bc-973fbc4a2246 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:30.664693 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 382/784] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Aug 19 19:13:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:13:31.720314 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790c18b-c0c7-4884-9f0f-b9d93fa3c393 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:31.720855 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790c18b-c0c7-4884-9f0f-b9d93fa3c393 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:31.720855 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790c18b-c0c7-4884-9f0f-b9d93fa3c393 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:31.722170 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 403/785] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:31.727713 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009424e1-f02c-42e9-83a8-81afc3f6d430 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:31.728139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009424e1-f02c-42e9-83a8-81afc3f6d430 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:31.728258 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009424e1-f02c-42e9-83a8-81afc3f6d430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:31.747699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-009424e1-f02c-42e9-83a8-81afc3f6d430 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:31.749601 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-009424e1-f02c-42e9-83a8-81afc3f6d430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:31.825448 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 383/786] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:31 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:13:32.150161 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790c18b-c0c7-4884-9f0f-b9d93fa3c393 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:32.251834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790c18b-c0c7-4884-9f0f-b9d93fa3c393 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:32.261357 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:32.285287 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5322515-bd54-4109-9602-1833fbf5217d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:32.285914 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5322515-bd54-4109-9602-1833fbf5217d None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:32.286190 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5322515-bd54-4109-9602-1833fbf5217d None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:32.286461 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5322515-bd54-4109-9602-1833fbf5217d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:32.287118 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5322515-bd54-4109-9602-1833fbf5217d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:32.288478 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5322515-bd54-4109-9602-1833fbf5217d None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:32.296984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-a5322515-bd54-4109-9602-1833fbf5217d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 19:13:32.296984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:32.296984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:13:32.296984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:13:32.296984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:13:32.296984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:13:32.296984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:13:32.296984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:32.296984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 19:13:32.296984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:32.296984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:32.296984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:32.296984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:32.296984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:32.296984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:32.296984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:32.296984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:32.297934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:32.297934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:32.297934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:32.297934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:32.297934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:32.297934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:32.297934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:13:32.297934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:13:32.297934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:13:32.297934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:13:32.297934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:32.297934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:32.297934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:32.297934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:32.297934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:32.297934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:32.298810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:32.298810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:32.298810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:32.298810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:32.298810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:32.298810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:32.298810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:32.298810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:32.298810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:32.298810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:32.298810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:13:32.298810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:32.298810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 19:13:32.298810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:32.298810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 404/787] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:13:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:32.304670 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009424e1-f02c-42e9-83a8-81afc3f6d430 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:32.364089 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:32.402818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009424e1-f02c-42e9-83a8-81afc3f6d430 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:32.436841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c4503-d7a2-4d8d-a954-6207ff5c30d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:32.437440 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c4503-d7a2-4d8d-a954-6207ff5c30d8 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:32.437714 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c4503-d7a2-4d8d-a954-6207ff5c30d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:32.437981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c4503-d7a2-4d8d-a954-6207ff5c30d8 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:32.438630 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c4503-d7a2-4d8d-a954-6207ff5c30d8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:32.438925 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c4503-d7a2-4d8d-a954-6207ff5c30d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:32.440315 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c4503-d7a2-4d8d-a954-6207ff5c30d8 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:32.445745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 384/788] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:13:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:32.451489 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5322515-bd54-4109-9602-1833fbf5217d None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:32.550350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5322515-bd54-4109-9602-1833fbf5217d None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:32.587228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36077157-46e5-49e9-8c18-e83c330ff931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:32.587826 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36077157-46e5-49e9-8c18-e83c330ff931 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:32.588099 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36077157-46e5-49e9-8c18-e83c330ff931 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:32.588365 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36077157-46e5-49e9-8c18-e83c330ff931 None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:32.588984 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36077157-46e5-49e9-8c18-e83c330ff931 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:32.589279 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36077157-46e5-49e9-8c18-e83c330ff931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:32.590667 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36077157-46e5-49e9-8c18-e83c330ff931 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:32.595326 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 405/789] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Aug 19 19:13:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:32.601303 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c4503-d7a2-4d8d-a954-6207ff5c30d8 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:32.699181 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c4503-d7a2-4d8d-a954-6207ff5c30d8 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:32.728501 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:32.737546 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83f29f-21fa-49f7-af65-9b57b5427c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:32.739533 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83f29f-21fa-49f7-af65-9b57b5427c96 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:32.739533 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83f29f-21fa-49f7-af65-9b57b5427c96 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:32.739533 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83f29f-21fa-49f7-af65-9b57b5427c96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:32.739533 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83f29f-21fa-49f7-af65-9b57b5427c96 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:32.740836 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83f29f-21fa-49f7-af65-9b57b5427c96 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:32.838722 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 385/790] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Aug 19 19:13:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:13:32.871328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d3abd-df5d-4850-9319-3a651de2fff0 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:32.871854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d3abd-df5d-4850-9319-3a651de2fff0 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:32.871854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d3abd-df5d-4850-9319-3a651de2fff0 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:32.873355 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 406/791] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:32.878902 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcee6ce-5070-4045-806f-b13a5307f19b None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:32.879205 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcee6ce-5070-4045-806f-b13a5307f19b None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:32.879477 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcee6ce-5070-4045-806f-b13a5307f19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:32.899634 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-7dcee6ce-5070-4045-806f-b13a5307f19b None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:32.900896 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7dcee6ce-5070-4045-806f-b13a5307f19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:32.978620 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 386/792] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:32 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:13:33.309876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d3abd-df5d-4850-9319-3a651de2fff0 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:33.345612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:33.412360 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d3abd-df5d-4850-9319-3a651de2fff0 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:33.447083 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd01a6b-a137-437a-90ba-3f7bef2bdaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:33.447704 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd01a6b-a137-437a-90ba-3f7bef2bdaab None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:33.447981 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd01a6b-a137-437a-90ba-3f7bef2bdaab None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:33.448248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd01a6b-a137-437a-90ba-3f7bef2bdaab None admin] PATH_INFO: `/v3/services/compute` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:33.448818 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd01a6b-a137-437a-90ba-3f7bef2bdaab None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:33.450177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd01a6b-a137-437a-90ba-3f7bef2bdaab None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:33.459235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-6bd01a6b-a137-437a-90ba-3f7bef2bdaab None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 19:13:33.459235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:33.459235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:13:33.459235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:13:33.459235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:13:33.459235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:13:33.459235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:13:33.459235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:33.459235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 19:13:33.459235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:33.459235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:33.459235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:33.459235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:33.459235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:33.459235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:33.459235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:33.459235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:33.460230 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:33.460230 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:33.460230 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:33.460230 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:33.460230 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:33.460230 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:33.460230 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:13:33.460230 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:13:33.460230 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:13:33.460230 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:13:33.460230 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:33.460230 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:33.460230 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:33.460230 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:33.460230 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:33.460230 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:33.461201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:33.461201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:33.461201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:33.461201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:33.461201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:33.461201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:33.461201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:33.461201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:33.461201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:33.461201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:33.461201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:13:33.461201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:33.461201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 19:13:33.461201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:33.461201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 407/793] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:13:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:33.469218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcee6ce-5070-4045-806f-b13a5307f19b None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:33.602121 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcee6ce-5070-4045-806f-b13a5307f19b None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:33.611810 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:33.636967 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c00ca-fd3d-47ed-bdaa-5ffa37f47589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:33.637563 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c00ca-fd3d-47ed-bdaa-5ffa37f47589 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:33.637839 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c00ca-fd3d-47ed-bdaa-5ffa37f47589 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:33.638108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c00ca-fd3d-47ed-bdaa-5ffa37f47589 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:33.638760 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c00ca-fd3d-47ed-bdaa-5ffa37f47589 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:33.639060 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c00ca-fd3d-47ed-bdaa-5ffa37f47589 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:33.640420 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c00ca-fd3d-47ed-bdaa-5ffa37f47589 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:33.644916 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 387/794] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Aug 19 19:13:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:33.650738 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd01a6b-a137-437a-90ba-3f7bef2bdaab None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:33.746673 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:33.749492 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd01a6b-a137-437a-90ba-3f7bef2bdaab None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:33.782705 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaf9ad-dc9a-4c73-9386-094c0b5a0277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:33.783300 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaf9ad-dc9a-4c73-9386-094c0b5a0277 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:33.783574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaf9ad-dc9a-4c73-9386-094c0b5a0277 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:33.783839 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaf9ad-dc9a-4c73-9386-094c0b5a0277 None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:33.784457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaf9ad-dc9a-4c73-9386-094c0b5a0277 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:33.784755 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaf9ad-dc9a-4c73-9386-094c0b5a0277 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:33.786106 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaf9ad-dc9a-4c73-9386-094c0b5a0277 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:33.791408 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 408/795] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Aug 19 19:13:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:35.118134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba998d50-9c36-44d5-9bcc-36ff2852cbfd None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:35.118711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba998d50-9c36-44d5-9bcc-36ff2852cbfd None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:35.118711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba998d50-9c36-44d5-9bcc-36ff2852cbfd None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:35.120025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 388/796] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:35.125214 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b7067-e01d-47a0-adbc-6278877fccf4 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:35.125628 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b7067-e01d-47a0-adbc-6278877fccf4 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:35.125753 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b7067-e01d-47a0-adbc-6278877fccf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:35.143907 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-e97b7067-e01d-47a0-adbc-6278877fccf4 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:35.145073 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-e97b7067-e01d-47a0-adbc-6278877fccf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:35.209809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 409/797] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:35 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:13:35.547041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba998d50-9c36-44d5-9bcc-36ff2852cbfd None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:35.650628 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba998d50-9c36-44d5-9bcc-36ff2852cbfd None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:35.684229 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d572a7-68f6-4345-8c44-9bbcd39fcfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:35.684823 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d572a7-68f6-4345-8c44-9bbcd39fcfa7 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:35.685101 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d572a7-68f6-4345-8c44-9bbcd39fcfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:35.685372 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d572a7-68f6-4345-8c44-9bbcd39fcfa7 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:35.686018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d572a7-68f6-4345-8c44-9bbcd39fcfa7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:35.687486 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d572a7-68f6-4345-8c44-9bbcd39fcfa7 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:35.690040 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: WARNING keystone.server.flask.common [None req-26d572a7-68f6-4345-8c44-9bbcd39fcfa7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 19:13:35.740468 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.sql.core [None req-26d572a7-68f6-4345-8c44-9bbcd39fcfa7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 19:13:35.740468 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 19:13:35.740468 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [parameters: {'id': 'bab530baa95041c39addc37a525bd066', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 19:13:35.740468 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88346) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 19:13:35.766477 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-26d572a7-68f6-4345-8c44-9bbcd39fcfa7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bab530baa95041c39addc37a525bd066.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bab530baa95041c39addc37a525bd066. Aug 19 19:13:35.766477 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:35.766477 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 19:13:35.766477 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 19:13:35.766477 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 19:13:35.766477 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 19:13:35.766477 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 19:13:35.766477 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 19:13:35.766477 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 19:13:35.766477 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application conn.query(q) Aug 19 19:13:35.766477 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 19:13:35.766477 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 19:13:35.766477 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 19:13:35.767502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application result.read() Aug 19 19:13:35.767502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 19:13:35.767502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 19:13:35.767502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 19:13:35.767502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 19:13:35.767502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 19:13:35.767502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 19:13:35.767502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 19:13:35.767502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 19:13:35.767502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 19:13:35.767502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:35.767502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 19:13:35.767502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:35.767502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:35.767502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 19:13:35.767502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 19:13:35.767502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 19 19:13:35.767502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 19 19:13:35.768653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 19:13:35.768653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application next(self.gen) Aug 19 19:13:35.768653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 19:13:35.768653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application yield resource Aug 19 19:13:35.768653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 19:13:35.768653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application next(self.gen) Aug 19 19:13:35.768653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 19:13:35.768653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 19:13:35.768653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 19:13:35.768653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 19:13:35.768653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 19:13:35.768653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise self.value Aug 19 19:13:35.768653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 19:13:35.768653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 19:13:35.768653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 19:13:35.768653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application session.commit() Aug 19 19:13:35.768653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 19:13:35.769789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 19:13:35.769789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 19:13:35.769789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 19:13:35.769789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 19:13:35.769789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self.session.flush() Aug 19 19:13:35.769789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 19:13:35.769789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 19:13:35.769789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 19:13:35.769789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 19:13:35.769789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 19:13:35.769789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application compat.raise_( Aug 19 19:13:35.769789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 19:13:35.769789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception Aug 19 19:13:35.769789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 19:13:35.769789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 19:13:35.769789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 19:13:35.769789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 19:13:35.771708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 19:13:35.771708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 19:13:35.771708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 19:13:35.771708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 19:13:35.771708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 19 19:13:35.771708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 19 19:13:35.771708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 19:13:35.771708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 19:13:35.771708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 19:13:35.771708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 19:13:35.771708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 19:13:35.771708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 19:13:35.771708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 19:13:35.771708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 19:13:35.771708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 19:13:35.772841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 19:13:35.772841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 19:13:35.772841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception Aug 19 19:13:35.772841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 19:13:35.772841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 19:13:35.772841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 19:13:35.772841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 19:13:35.772841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 19:13:35.772841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 19:13:35.772841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 19:13:35.772841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application conn.query(q) Aug 19 19:13:35.772841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 19:13:35.772841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 19:13:35.772841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 19:13:35.772841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application result.read() Aug 19 19:13:35.772841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 19:13:35.772841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 19:13:35.774292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 19:13:35.774292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 19:13:35.774292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 19:13:35.774292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 19:13:35.774292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 19:13:35.774292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 19:13:35.774292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 19:13:35.774292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 19:13:35.774292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [parameters: {'id': 'bab530baa95041c39addc37a525bd066', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 19:13:35.774292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 19:13:35.774292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:35.774292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:35.774292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:35.774292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:35.774292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 19 19:13:35.776119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 19 19:13:35.776119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 19:13:35.776119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 19:13:35.776119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 19 19:13:35.776119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:35.776119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:35.776119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:35.776119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:35.776119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:35.776119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:35.776119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:35.776119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:35.776119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:35.776119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:35.776119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:35.776119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:35.776119 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:35.777837 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:35.777837 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 19 19:13:35.777837 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 19 19:13:35.777837 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:35.777837 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:35.777837 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 19 19:13:35.777837 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 19 19:13:35.777837 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bab530baa95041c39addc37a525bd066. Aug 19 19:13:35.777837 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:35.777837 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 389/798] 10.222.0.61 () {60 vars in 1140 bytes} [Fri Aug 19 19:13:35 2022] POST /identity/v3/projects => generated 262 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:35.779556 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b7067-e01d-47a0-adbc-6278877fccf4 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:35.866819 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:35.873658 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b7067-e01d-47a0-adbc-6278877fccf4 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:35.907698 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda7ac6-5510-412e-a489-ecf2151660db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:35.908349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda7ac6-5510-412e-a489-ecf2151660db None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:35.908625 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda7ac6-5510-412e-a489-ecf2151660db None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:35.908949 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda7ac6-5510-412e-a489-ecf2151660db None admin] PATH_INFO: `/v3/projects/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:35.916965 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda7ac6-5510-412e-a489-ecf2151660db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:35.918444 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda7ac6-5510-412e-a489-ecf2151660db None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:35.931894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-ccda7ac6-5510-412e-a489-ecf2151660db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:13:35.931894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:35.931894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:35.931894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:35.931894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:35.931894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:35.931894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:35.931894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:35.931894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:35.931894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:35.931894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:35.931894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:35.931894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:13:35.931894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:13:35.931894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:13:35.932889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:13:35.932889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:35.932889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:35.932889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:35.932889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:35.932889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:35.932889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:35.932889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:35.932889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:35.932889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:35.932889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:35.932889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:35.932889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:35.932889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:35.932889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:35.932889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:35.932889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:35.933788 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:13:35.933788 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:13:35.933788 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:13:35.933788 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:13:35.933788 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:13:35.933788 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:13:35.933788 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:13:35.933788 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:35.933788 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 410/799] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:13:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:35.939392 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d572a7-68f6-4345-8c44-9bbcd39fcfa7 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:35.971257 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:36.042832 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d572a7-68f6-4345-8c44-9bbcd39fcfa7 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:36.074936 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d8f45-550a-45d9-92c2-b9803e2e0fe0 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:36.075216 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d8f45-550a-45d9-92c2-b9803e2e0fe0 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:36.075486 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d8f45-550a-45d9-92c2-b9803e2e0fe0 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:36.076751 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af36ad-a76d-48a6-8b87-f7c4e3054839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:36.076954 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 411/800] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:13:36.077350 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af36ad-a76d-48a6-8b87-f7c4e3054839 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:36.077623 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af36ad-a76d-48a6-8b87-f7c4e3054839 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:36.077891 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af36ad-a76d-48a6-8b87-f7c4e3054839 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:36.078556 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af36ad-a76d-48a6-8b87-f7c4e3054839 None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:36.078859 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af36ad-a76d-48a6-8b87-f7c4e3054839 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:36.080469 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af36ad-a76d-48a6-8b87-f7c4e3054839 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:36.081674 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a83ab-ab7f-49e8-a863-8ba81ebfb6a3 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:36.081960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a83ab-ab7f-49e8-a863-8ba81ebfb6a3 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:36.082236 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a83ab-ab7f-49e8-a863-8ba81ebfb6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:36.099978 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-fa6a83ab-ab7f-49e8-a863-8ba81ebfb6a3 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:36.101204 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-fa6a83ab-ab7f-49e8-a863-8ba81ebfb6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:36.102670 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 390/801] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Aug 19 19:13:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:36.173908 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 412/802] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:36 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:13:36.500409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af36ad-a76d-48a6-8b87-f7c4e3054839 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:36.590244 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:36.602051 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af36ad-a76d-48a6-8b87-f7c4e3054839 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:36.637599 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101d73b-d0be-47e2-a587-52827e1eca51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:36.638212 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101d73b-d0be-47e2-a587-52827e1eca51 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:36.638487 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101d73b-d0be-47e2-a587-52827e1eca51 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:36.638787 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101d73b-d0be-47e2-a587-52827e1eca51 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:36.639470 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101d73b-d0be-47e2-a587-52827e1eca51 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:36.641294 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101d73b-d0be-47e2-a587-52827e1eca51 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:36.709857 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 391/803] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Aug 19 19:13:36 2022] POST /identity/v3/services => generated 242 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:13:38.355916 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4038a0f-81cb-4263-b2cc-2cf324bce50f None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:38.356473 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4038a0f-81cb-4263-b2cc-2cf324bce50f None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:38.356473 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4038a0f-81cb-4263-b2cc-2cf324bce50f None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:38.357761 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 413/804] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:38.363195 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027e4c8-ff4f-476f-a4a6-7dd90b8fd779 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:38.363592 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027e4c8-ff4f-476f-a4a6-7dd90b8fd779 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:38.363847 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027e4c8-ff4f-476f-a4a6-7dd90b8fd779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:38.382414 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-5027e4c8-ff4f-476f-a4a6-7dd90b8fd779 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:38.384022 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5027e4c8-ff4f-476f-a4a6-7dd90b8fd779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:38.454802 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 392/805] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:38 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:13:38.790017 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4038a0f-81cb-4263-b2cc-2cf324bce50f None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:38.873742 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:38.890918 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4038a0f-81cb-4263-b2cc-2cf324bce50f None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:38.919133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8aa205-5998-4265-8507-cfb03b3e90ae None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:38.919419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8aa205-5998-4265-8507-cfb03b3e90ae None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:38.919694 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8aa205-5998-4265-8507-cfb03b3e90ae None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:38.921040 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 393/806] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:13:38.923933 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e53432-0b50-4351-a59d-22b0e32f7311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:38.924609 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e53432-0b50-4351-a59d-22b0e32f7311 None admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:38.924897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e53432-0b50-4351-a59d-22b0e32f7311 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:38.925166 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e53432-0b50-4351-a59d-22b0e32f7311 None admin] PATH_INFO: `/v3/users` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:38.925785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e53432-0b50-4351-a59d-22b0e32f7311 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:38.925927 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b5ea0-411f-4581-8a41-6096bc65778c None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:38.926205 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b5ea0-411f-4581-8a41-6096bc65778c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:38.926475 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b5ea0-411f-4581-8a41-6096bc65778c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:38.927924 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e53432-0b50-4351-a59d-22b0e32f7311 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:38.930559 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: WARNING keystone.server.flask.common [None req-89e53432-0b50-4351-a59d-22b0e32f7311 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 19:13:38.947333 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-995b5ea0-411f-4581-8a41-6096bc65778c None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:38.948528 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-995b5ea0-411f-4581-8a41-6096bc65778c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:38.986577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.sql.core [None req-89e53432-0b50-4351-a59d-22b0e32f7311 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 19:13:38.986577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 19:13:38.986577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [parameters: {'user_id': '7607f0af340245afb1bf66dc899a31d3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 19:13:38.986577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88347) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 19:13:39.003641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-89e53432-0b50-4351-a59d-22b0e32f7311 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 19:13:39.003641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:39.003641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 19:13:39.003641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 19:13:39.003641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 19:13:39.003641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 19:13:39.003641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 19:13:39.003641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 19:13:39.003641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 19:13:39.003641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application conn.query(q) Aug 19 19:13:39.003641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 19:13:39.003641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 19:13:39.003641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 19:13:39.003641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application result.read() Aug 19 19:13:39.003641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 19:13:39.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 19:13:39.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 19:13:39.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 19:13:39.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 19:13:39.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 19:13:39.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 19:13:39.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 19:13:39.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 19:13:39.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:39.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 19:13:39.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:39.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:39.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 19:13:39.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 19:13:39.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 19 19:13:39.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 19 19:13:39.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 19:13:39.004712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application next(self.gen) Aug 19 19:13:39.006815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 19:13:39.006815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application yield resource Aug 19 19:13:39.006815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 19:13:39.006815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application next(self.gen) Aug 19 19:13:39.006815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 19:13:39.006815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 19:13:39.006815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 19:13:39.006815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 19:13:39.006815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 19:13:39.006815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise self.value Aug 19 19:13:39.006815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 19:13:39.006815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 19:13:39.006815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 19:13:39.006815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application session.commit() Aug 19 19:13:39.006815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 19:13:39.006815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 19:13:39.006815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 19:13:39.007692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 19:13:39.007692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 19:13:39.007692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self.session.flush() Aug 19 19:13:39.007692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 19:13:39.007692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 19:13:39.007692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 19:13:39.007692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 19:13:39.007692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 19:13:39.007692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application compat.raise_( Aug 19 19:13:39.007692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 19:13:39.007692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception Aug 19 19:13:39.007692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 19:13:39.007692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 19:13:39.007692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 19:13:39.007692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 19:13:39.007692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 19:13:39.007692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 19:13:39.008568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 19:13:39.008568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 19:13:39.008568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 19 19:13:39.008568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 19 19:13:39.008568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 19:13:39.008568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 19:13:39.008568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 19:13:39.008568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 19:13:39.008568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 19:13:39.008568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 19:13:39.008568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 19:13:39.008568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 19:13:39.008568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 19:13:39.008568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 19:13:39.008568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 19:13:39.008568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception Aug 19 19:13:39.009399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 19:13:39.009399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 19:13:39.009399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 19:13:39.009399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 19:13:39.009399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 19:13:39.009399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 19:13:39.009399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 19:13:39.009399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application conn.query(q) Aug 19 19:13:39.009399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 19:13:39.009399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 19:13:39.009399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 19:13:39.009399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application result.read() Aug 19 19:13:39.009399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 19:13:39.009399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 19:13:39.009399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 19:13:39.009399 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 19:13:39.010241 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 19:13:39.010241 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 19:13:39.010241 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 19:13:39.010241 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 19:13:39.010241 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 19:13:39.010241 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 19:13:39.010241 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [parameters: {'user_id': '7607f0af340245afb1bf66dc899a31d3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 19:13:39.010241 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 19:13:39.010241 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:39.010241 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:39.010241 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:39.010241 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:39.010241 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:39.010241 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:39.010241 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:39.011566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:39.011566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:39.011566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:39.011566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:39.011566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:39.011566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:39.011566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:39.011566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 19 19:13:39.011566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 19 19:13:39.011566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:39.011566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:39.011566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:13:39.011566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:13:39.011566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:13:39.011566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:13:39.011566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 19 19:13:39.011566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 19 19:13:39.012857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 19 19:13:39.012857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 19 19:13:39.012857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 19:13:39.012857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 19:13:39.012857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 19:13:39.012857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:39.012857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 414/807] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Aug 19 19:13:38 2022] POST /identity/v3/users => generated 160 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:39.012857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e53432-0b50-4351-a59d-22b0e32f7311 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:39.017085 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 394/808] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:38 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:13:39.113578 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e53432-0b50-4351-a59d-22b0e32f7311 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:39.147183 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317c0b1-913f-4cf5-b15f-f9933884c5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:39.147807 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317c0b1-913f-4cf5-b15f-f9933884c5f1 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:39.148086 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317c0b1-913f-4cf5-b15f-f9933884c5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:39.148357 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317c0b1-913f-4cf5-b15f-f9933884c5f1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:39.155662 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317c0b1-913f-4cf5-b15f-f9933884c5f1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:39.157364 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317c0b1-913f-4cf5-b15f-f9933884c5f1 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:39.168782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-8317c0b1-913f-4cf5-b15f-f9933884c5f1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 19:13:39.168782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:39.168782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:39.168782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:39.168782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:39.168782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:39.168782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:39.168782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:39.168782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:39.168782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:39.168782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:39.168782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:39.168782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:13:39.168782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:13:39.168782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:13:39.168782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:13:39.169854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:39.169854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:39.169854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:13:39.169854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:13:39.169854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:13:39.169854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:13:39.169854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:39.169854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:39.169854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:39.169854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:39.169854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:39.169854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:39.169854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:39.169854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:39.169854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:39.169854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:39.169854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:39.169854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:39.171264 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:39.171264 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:39.171264 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:13:39.171264 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:13:39.171264 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:13:39.171264 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:13:39.171264 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:13:39.171264 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:13:39.171264 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 19:13:39.171264 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:39.171264 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 415/809] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:13:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:13:39.175596 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b5ea0-411f-4581-8a41-6096bc65778c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:39.179815 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:39.273772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b5ea0-411f-4581-8a41-6096bc65778c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:39.313319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a8f70-bf01-410e-aaa8-06fbdc45a3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:39.314115 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a8f70-bf01-410e-aaa8-06fbdc45a3b2 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:39.314390 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a8f70-bf01-410e-aaa8-06fbdc45a3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:39.314798 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a8f70-bf01-410e-aaa8-06fbdc45a3b2 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:39.315766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a8f70-bf01-410e-aaa8-06fbdc45a3b2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:39.316066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a8f70-bf01-410e-aaa8-06fbdc45a3b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:39.317516 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a8f70-bf01-410e-aaa8-06fbdc45a3b2 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:39.344087 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317c0b1-913f-4cf5-b15f-f9933884c5f1 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:39.353843 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:39.354010 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 395/810] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Aug 19 19:13:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:13:39.461419 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317c0b1-913f-4cf5-b15f-f9933884c5f1 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:39.497832 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43463ee0-2b7e-4b87-b931-fb61525b7e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:39.498462 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43463ee0-2b7e-4b87-b931-fb61525b7e8e None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:39.498792 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43463ee0-2b7e-4b87-b931-fb61525b7e8e None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:39.499061 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43463ee0-2b7e-4b87-b931-fb61525b7e8e None admin] PATH_INFO: `/v3/services/compute` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:39.499655 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43463ee0-2b7e-4b87-b931-fb61525b7e8e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:39.501045 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43463ee0-2b7e-4b87-b931-fb61525b7e8e None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:39.510415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-43463ee0-2b7e-4b87-b931-fb61525b7e8e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 19:13:39.510415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:39.510415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:13:39.510415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:13:39.510415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:13:39.510415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:13:39.510415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:13:39.510415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:39.510415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 19:13:39.510415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:39.510415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:39.510415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:39.510415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:39.510415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:39.510415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:39.510415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:39.510415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:39.511667 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:39.511667 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:39.511667 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:39.511667 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:39.511667 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:39.511667 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:39.511667 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:13:39.511667 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:13:39.511667 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:13:39.511667 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:13:39.511667 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:39.511667 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:39.511667 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:39.511667 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:39.511667 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:39.511667 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:39.512579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:39.512579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:39.512579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:39.512579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:39.512579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:39.512579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:39.512579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:39.512579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:39.512579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:39.512579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:39.512579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:13:39.512579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:39.512579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 19:13:39.512579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:13:39.512579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 416/811] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:13:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:13:39.517972 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a8f70-bf01-410e-aaa8-06fbdc45a3b2 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:39.587050 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:39.626851 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a8f70-bf01-410e-aaa8-06fbdc45a3b2 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:39.660561 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbaec5-6b50-40e4-96b4-514e5384deaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:39.661180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbaec5-6b50-40e4-96b4-514e5384deaf None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:39.661464 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbaec5-6b50-40e4-96b4-514e5384deaf None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:39.661741 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbaec5-6b50-40e4-96b4-514e5384deaf None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:39.662362 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbaec5-6b50-40e4-96b4-514e5384deaf None admin] RBAC: Adding query filter params (name=compute) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:39.662738 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbaec5-6b50-40e4-96b4-514e5384deaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:39.664108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbaec5-6b50-40e4-96b4-514e5384deaf None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:39.668829 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 396/812] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Aug 19 19:13:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:39.674551 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43463ee0-2b7e-4b87-b931-fb61525b7e8e None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:39.743282 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:39.775508 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43463ee0-2b7e-4b87-b931-fb61525b7e8e None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:39.808050 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd5f1e-6f67-417f-8013-ce86e8070516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:39.808627 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd5f1e-6f67-417f-8013-ce86e8070516 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:39.808904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd5f1e-6f67-417f-8013-ce86e8070516 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:39.809170 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd5f1e-6f67-417f-8013-ce86e8070516 None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:39.809783 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd5f1e-6f67-417f-8013-ce86e8070516 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:39.810084 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd5f1e-6f67-417f-8013-ce86e8070516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:39.811455 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd5f1e-6f67-417f-8013-ce86e8070516 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:39.819121 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 417/813] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Aug 19 19:13:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:39.825243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbaec5-6b50-40e4-96b4-514e5384deaf None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:39.922922 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbaec5-6b50-40e4-96b4-514e5384deaf None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:39.947775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:39.956175 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028894c-bb84-4dad-8625-a639708df911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:39.956774 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028894c-bb84-4dad-8625-a639708df911 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:39.957053 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028894c-bb84-4dad-8625-a639708df911 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:39.973352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028894c-bb84-4dad-8625-a639708df911 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:39.973352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028894c-bb84-4dad-8625-a639708df911 None admin] RBAC: Adding query filter params (interface=public, service_id=63edcdbb721047ff910dd71f46abf681, region_id=RegionOne) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:39.973352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028894c-bb84-4dad-8625-a639708df911 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:39.973352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028894c-bb84-4dad-8625-a639708df911 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:39.973352 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 397/814] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Aug 19 19:13:39 2022] GET /identity/v3/endpoints?service_id=63edcdbb721047ff910dd71f46abf681&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:39.973791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd5f1e-6f67-417f-8013-ce86e8070516 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:40.070471 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd5f1e-6f67-417f-8013-ce86e8070516 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:40.103690 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b584f8-6705-4b34-9c09-41dac197c348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:40.104280 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b584f8-6705-4b34-9c09-41dac197c348 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:40.104648 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b584f8-6705-4b34-9c09-41dac197c348 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:40.104826 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b584f8-6705-4b34-9c09-41dac197c348 None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:40.105418 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b584f8-6705-4b34-9c09-41dac197c348 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:40.106803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b584f8-6705-4b34-9c09-41dac197c348 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:40.107797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:40.113281 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 418/815] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Aug 19 19:13:39 2022] GET /identity/v3/services => generated 1728 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:13:42.283241 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f232ad-2772-47d7-925c-1cb7a64fe38d None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:42.283770 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f232ad-2772-47d7-925c-1cb7a64fe38d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:42.283770 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f232ad-2772-47d7-925c-1cb7a64fe38d None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:42.285111 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 398/816] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:13:42.290374 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d412b-5ff6-41e9-9009-b5da4dc5d31b None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:42.290771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d412b-5ff6-41e9-9009-b5da4dc5d31b None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:42.290957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d412b-5ff6-41e9-9009-b5da4dc5d31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:42.309445 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-518d412b-5ff6-41e9-9009-b5da4dc5d31b None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:13:42.310993 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-518d412b-5ff6-41e9-9009-b5da4dc5d31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:13:42.375559 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 419/817] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:13:42 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:13:42.696346 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f232ad-2772-47d7-925c-1cb7a64fe38d None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:42.795715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f232ad-2772-47d7-925c-1cb7a64fe38d None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:42.829901 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c29a8d-8b9e-43d0-bff7-72e6d9511b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:42.830471 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c29a8d-8b9e-43d0-bff7-72e6d9511b93 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:42.830780 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c29a8d-8b9e-43d0-bff7-72e6d9511b93 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:42.831053 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c29a8d-8b9e-43d0-bff7-72e6d9511b93 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:42.831633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c29a8d-8b9e-43d0-bff7-72e6d9511b93 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:42.833034 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c29a8d-8b9e-43d0-bff7-72e6d9511b93 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:42.841506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-e4c29a8d-8b9e-43d0-bff7-72e6d9511b93 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 19:13:42.841506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:42.841506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:13:42.841506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:13:42.841506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:13:42.841506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:13:42.841506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:13:42.841506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:42.841506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 19:13:42.841506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:42.841506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:13:42.841506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:42.841506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:13:42.841506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:13:42.841506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:13:42.841506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:13:42.841506 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:13:42.842660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:13:42.842660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:13:42.842660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:13:42.842660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:13:42.842660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:13:42.842660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:13:42.842660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:13:42.842660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:13:42.842660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:13:42.842660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:13:42.842660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:13:42.842660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:13:42.842660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:13:42.842660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:13:42.842660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:13:42.842660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:13:42.843702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:13:42.843702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:13:42.843702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:13:42.843702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:13:42.843702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:13:42.843702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:13:42.843702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:13:42.843702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:13:42.843702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:13:42.843702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:13:42.843702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:13:42.843702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:13:42.843702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 19:13:42.843702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:13:42.843702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 399/818] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:13:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:13:42.849423 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d412b-5ff6-41e9-9009-b5da4dc5d31b None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:42.949355 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d412b-5ff6-41e9-9009-b5da4dc5d31b None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:42.977143 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:42.990225 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4a6ed-c266-4e59-a56a-4ba9b7afa95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:42.993226 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4a6ed-c266-4e59-a56a-4ba9b7afa95e None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:42.993510 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4a6ed-c266-4e59-a56a-4ba9b7afa95e None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:42.993781 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4a6ed-c266-4e59-a56a-4ba9b7afa95e None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:42.994414 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4a6ed-c266-4e59-a56a-4ba9b7afa95e None admin] RBAC: Adding query filter params (name=compute) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:42.994770 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4a6ed-c266-4e59-a56a-4ba9b7afa95e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:42.996121 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4a6ed-c266-4e59-a56a-4ba9b7afa95e None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:43.001126 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 420/819] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Aug 19 19:13:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:43.007283 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c29a8d-8b9e-43d0-bff7-72e6d9511b93 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:43.061651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:43.106437 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c29a8d-8b9e-43d0-bff7-72e6d9511b93 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:43.139446 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb9e1e-8d3c-4629-9250-0bb67f62c38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:43.140042 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb9e1e-8d3c-4629-9250-0bb67f62c38b None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:43.140318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb9e1e-8d3c-4629-9250-0bb67f62c38b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:43.140589 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb9e1e-8d3c-4629-9250-0bb67f62c38b None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:43.141205 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb9e1e-8d3c-4629-9250-0bb67f62c38b None admin] RBAC: Adding query filter params (type=compute) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:13:43.141504 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb9e1e-8d3c-4629-9250-0bb67f62c38b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:43.142896 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb9e1e-8d3c-4629-9250-0bb67f62c38b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:43.147694 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 400/820] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Aug 19 19:13:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:13:43.153702 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4a6ed-c266-4e59-a56a-4ba9b7afa95e None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:13:43.257061 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4a6ed-c266-4e59-a56a-4ba9b7afa95e None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:13:43.291574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5a244-b087-445c-883e-daa9ada148dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:13:43.292210 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5a244-b087-445c-883e-daa9ada148dc None admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:13:43.292440 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5a244-b087-445c-883e-daa9ada148dc None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:13:43.292710 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5a244-b087-445c-883e-daa9ada148dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:13:43.293372 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5a244-b087-445c-883e-daa9ada148dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:13:43.294777 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5a244-b087-445c-883e-daa9ada148dc None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:13:43.379224 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 421/821] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Aug 19 19:13:43 2022] POST /identity/v3/endpoints => generated 334 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:13:53.145180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=41 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:13:53.373549 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=75,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:02.748572 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc644ad-fa9e-40c2-bf39-9ad52b4ad0a5 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:02.749146 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc644ad-fa9e-40c2-bf39-9ad52b4ad0a5 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:02.749146 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc644ad-fa9e-40c2-bf39-9ad52b4ad0a5 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:02.750462 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 401/822] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:15:02.756727 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23116b-0bf1-45d8-933f-4f2efffc98e4 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:02.757148 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23116b-0bf1-45d8-933f-4f2efffc98e4 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:02.757269 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23116b-0bf1-45d8-933f-4f2efffc98e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:02.776006 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-db23116b-0bf1-45d8-933f-4f2efffc98e4 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:15:02.777195 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-db23116b-0bf1-45d8-933f-4f2efffc98e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:15:02.853836 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 422/823] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:15:02 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:15:03.191177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc644ad-fa9e-40c2-bf39-9ad52b4ad0a5 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:03.293497 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc644ad-fa9e-40c2-bf39-9ad52b4ad0a5 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:03.327614 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f858dd5-124a-404f-b49e-eb6252d15e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:03.328242 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f858dd5-124a-404f-b49e-eb6252d15e68 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:03.328516 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f858dd5-124a-404f-b49e-eb6252d15e68 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:03.328783 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f858dd5-124a-404f-b49e-eb6252d15e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:03.339282 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f858dd5-124a-404f-b49e-eb6252d15e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:03.340704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f858dd5-124a-404f-b49e-eb6252d15e68 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:03.354180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-5f858dd5-124a-404f-b49e-eb6252d15e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:03.354180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:03.354180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:03.354180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:03.354180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:03.354180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:03.354180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:03.354180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:03.354180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:03.354180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:03.354180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:03.354180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:03.354180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:15:03.354180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:15:03.354180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:15:03.354180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:15:03.358708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:03.358708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:03.358708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:03.358708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:03.358708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:03.358708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:03.358708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:03.358708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:03.358708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:03.358708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:03.358708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:03.358708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:03.358708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:03.358708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:03.358708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:03.358708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:03.358708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:15:03.359850 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:15:03.359850 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:03.359850 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:15:03.359850 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 402/824] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:03.361636 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23116b-0bf1-45d8-933f-4f2efffc98e4 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:03.459095 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23116b-0bf1-45d8-933f-4f2efffc98e4 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:03.484750 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:03.493862 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534be65-60b7-44ed-a419-fa2e987ebd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:03.494457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534be65-60b7-44ed-a419-fa2e987ebd04 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:03.494760 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534be65-60b7-44ed-a419-fa2e987ebd04 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:03.495025 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534be65-60b7-44ed-a419-fa2e987ebd04 None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:03.495648 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534be65-60b7-44ed-a419-fa2e987ebd04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:03.495941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534be65-60b7-44ed-a419-fa2e987ebd04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:03.497293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534be65-60b7-44ed-a419-fa2e987ebd04 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:03.508443 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 423/825] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:03.514191 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f858dd5-124a-404f-b49e-eb6252d15e68 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:03.567922 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:03.614403 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f858dd5-124a-404f-b49e-eb6252d15e68 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:03.647264 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdce3a-0539-4d04-a53e-12be99544d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:03.647864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdce3a-0539-4d04-a53e-12be99544d64 None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:03.648140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdce3a-0539-4d04-a53e-12be99544d64 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:03.648408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdce3a-0539-4d04-a53e-12be99544d64 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:03.649060 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdce3a-0539-4d04-a53e-12be99544d64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:03.650505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdce3a-0539-4d04-a53e-12be99544d64 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:03.757156 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 403/826] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Aug 19 19:15:03 2022] POST /identity/v3/users => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:15:06.023952 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630c625-0c55-47d0-bebe-747a0e811557 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:06.024470 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630c625-0c55-47d0-bebe-747a0e811557 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:06.024470 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630c625-0c55-47d0-bebe-747a0e811557 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:06.025791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 424/827] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:15:06.031155 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908836c-da2d-4c94-9084-2ab3373bd146 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:06.033866 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908836c-da2d-4c94-9084-2ab3373bd146 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:06.033866 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908836c-da2d-4c94-9084-2ab3373bd146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:06.050938 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a908836c-da2d-4c94-9084-2ab3373bd146 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:15:06.052211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a908836c-da2d-4c94-9084-2ab3373bd146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:15:06.119065 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 404/828] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:15:06 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:15:06.465618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630c625-0c55-47d0-bebe-747a0e811557 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:06.568686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630c625-0c55-47d0-bebe-747a0e811557 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:06.605042 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084e9ed-6589-4fe2-a732-c48468e06e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:06.605668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084e9ed-6589-4fe2-a732-c48468e06e06 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:06.605941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084e9ed-6589-4fe2-a732-c48468e06e06 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:06.606203 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084e9ed-6589-4fe2-a732-c48468e06e06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:06.617982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084e9ed-6589-4fe2-a732-c48468e06e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:15:06.622599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-0084e9ed-6589-4fe2-a732-c48468e06e06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:15:06.622599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:06.622599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:06.622599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:06.622599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:06.622599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:06.622599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:06.622599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:06.622599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:06.622599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:06.622599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:06.622599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:06.622599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:15:06.622599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:15:06.622599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:15:06.622599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:15:06.623767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:15:06.623767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:15:06.623767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:15:06.623767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:15:06.623767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:06.623767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:06.623767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:06.623767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:06.623767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:06.623767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:06.623767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:06.623767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:06.623767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:06.623767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:06.623767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:06.623767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:06.624785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:06.624785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:06.624785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:06.624785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:06.624785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:15:06.624785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:15:06.624785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:15:06.624785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:15:06.624785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:15:06.624785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:15:06.624785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:15:06.624785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:06.624785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 425/829] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Aug 19 19:15:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:06.630971 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908836c-da2d-4c94-9084-2ab3373bd146 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:06.669512 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:06.728472 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908836c-da2d-4c94-9084-2ab3373bd146 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:06.762324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cd8a8-3772-469a-baf0-268b6cb0791a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:06.762946 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cd8a8-3772-469a-baf0-268b6cb0791a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:06.763227 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cd8a8-3772-469a-baf0-268b6cb0791a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:06.763499 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cd8a8-3772-469a-baf0-268b6cb0791a None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:06.764157 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cd8a8-3772-469a-baf0-268b6cb0791a None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:06.764455 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cd8a8-3772-469a-baf0-268b6cb0791a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:06.765824 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cd8a8-3772-469a-baf0-268b6cb0791a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:06.774446 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 405/830] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Aug 19 19:15:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:06.780561 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084e9ed-6589-4fe2-a732-c48468e06e06 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:06.827027 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:06.879544 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084e9ed-6589-4fe2-a732-c48468e06e06 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:06.911950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2168120-674f-416f-b2c4-e5986f3d28be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:06.912571 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2168120-674f-416f-b2c4-e5986f3d28be None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:06.912847 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2168120-674f-416f-b2c4-e5986f3d28be None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:06.913116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2168120-674f-416f-b2c4-e5986f3d28be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:06.923394 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2168120-674f-416f-b2c4-e5986f3d28be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:06.924821 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2168120-674f-416f-b2c4-e5986f3d28be None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:06.938491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-b2168120-674f-416f-b2c4-e5986f3d28be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:06.938491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:06.938491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:06.938491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:06.938491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:06.938491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:06.938491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:06.938491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:06.938491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:06.938491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:06.938491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:06.938491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:06.938491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:15:06.938491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:15:06.938491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:15:06.938491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:15:06.944972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:06.944972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:06.944972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:06.944972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:06.944972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:06.944972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:06.944972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:06.944972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:06.944972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:06.944972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:06.944972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:06.944972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:06.944972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:06.944972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:06.944972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:06.944972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:06.944972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:15:06.946150 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:15:06.946150 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:06.946150 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:06.946150 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 426/831] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:06.946445 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cd8a8-3772-469a-baf0-268b6cb0791a None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:07.051306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:07.054371 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cd8a8-3772-469a-baf0-268b6cb0791a None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:07.087628 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd722a-cecc-405a-8859-384009bb9326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:07.090693 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd722a-cecc-405a-8859-384009bb9326 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:07.090693 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd722a-cecc-405a-8859-384009bb9326 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:07.090693 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd722a-cecc-405a-8859-384009bb9326 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:07.090693 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd722a-cecc-405a-8859-384009bb9326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:07.090693 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd722a-cecc-405a-8859-384009bb9326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:07.091161 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd722a-cecc-405a-8859-384009bb9326 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:07.103208 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 406/832] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:15:07.108899 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2168120-674f-416f-b2c4-e5986f3d28be None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:07.206132 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:07.210576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2168120-674f-416f-b2c4-e5986f3d28be None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:07.244030 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ee193-7266-4e3f-ba54-2b6825087720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:07.244646 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ee193-7266-4e3f-ba54-2b6825087720 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:07.244958 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ee193-7266-4e3f-ba54-2b6825087720 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:07.245223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ee193-7266-4e3f-ba54-2b6825087720 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:07.252530 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ee193-7266-4e3f-ba54-2b6825087720 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:07.254016 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ee193-7266-4e3f-ba54-2b6825087720 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:07.264722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-311ee193-7266-4e3f-ba54-2b6825087720 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:15:07.264722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:07.264722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:07.264722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:07.264722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:07.264722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:07.264722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:07.264722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:07.264722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:07.264722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:07.264722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:07.264722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:07.264722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:15:07.264722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:15:07.264722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:15:07.264722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:15:07.267679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:07.267679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:07.267679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:15:07.267679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:15:07.267679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:15:07.267679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:15:07.267679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:07.267679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:07.267679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:07.267679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:07.267679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:07.267679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:07.267679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:07.267679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:07.267679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:07.267679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:07.267679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:07.267679 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:07.269385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:07.269385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:07.269385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:15:07.269385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:15:07.269385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:15:07.269385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:15:07.269385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:15:07.269385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:15:07.269385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:15:07.269385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:07.269385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 427/833] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:07.272600 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd722a-cecc-405a-8859-384009bb9326 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:07.379049 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd722a-cecc-405a-8859-384009bb9326 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:07.412574 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c43f49-13e5-4e7f-b77d-481237d2f875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:07.413168 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c43f49-13e5-4e7f-b77d-481237d2f875 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:07.413440 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c43f49-13e5-4e7f-b77d-481237d2f875 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:07.413706 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c43f49-13e5-4e7f-b77d-481237d2f875 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:07.414415 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c43f49-13e5-4e7f-b77d-481237d2f875 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:07.414781 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c43f49-13e5-4e7f-b77d-481237d2f875 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:07.416180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c43f49-13e5-4e7f-b77d-481237d2f875 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:07.432519 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 407/834] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Aug 19 19:15:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:07.438383 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ee193-7266-4e3f-ba54-2b6825087720 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:07.538699 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ee193-7266-4e3f-ba54-2b6825087720 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:07.574293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6982def-e75e-418d-b1f6-f009610509c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:07.575101 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6982def-e75e-418d-b1f6-f009610509c8 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:07.575252 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6982def-e75e-418d-b1f6-f009610509c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:07.575519 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6982def-e75e-418d-b1f6-f009610509c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:07.604486 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:07.643576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6982def-e75e-418d-b1f6-f009610509c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:07.645687 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6982def-e75e-418d-b1f6-f009610509c8 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:07.742214 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 428/835] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:15:07 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 19:15:07.748234 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c43f49-13e5-4e7f-b77d-481237d2f875 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:07.767590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:07.852482 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c43f49-13e5-4e7f-b77d-481237d2f875 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:07.888705 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149586b8-785b-4761-aae9-87d0daacd8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:07.889339 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149586b8-785b-4761-aae9-87d0daacd8c3 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:07.889618 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149586b8-785b-4761-aae9-87d0daacd8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:07.889892 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149586b8-785b-4761-aae9-87d0daacd8c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:07.900697 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149586b8-785b-4761-aae9-87d0daacd8c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:07.902092 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149586b8-785b-4761-aae9-87d0daacd8c3 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:07.916523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-149586b8-785b-4761-aae9-87d0daacd8c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:07.916523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:07.916523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:07.916523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:07.916523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:07.916523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:07.916523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:07.916523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:07.916523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:07.916523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:07.916523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:07.916523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:07.916523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:15:07.916523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:15:07.916523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:15:07.916523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:15:07.917500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:07.917500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:07.917500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:07.917500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:07.917500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:07.917500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:07.917500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:07.917500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:07.917500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:07.917500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:07.917500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:07.917500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:07.917500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:07.917500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:07.917500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:07.917500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:07.917500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:15:07.918757 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:15:07.918757 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:07.918757 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:15:07.918757 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 408/836] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:07.923337 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6982def-e75e-418d-b1f6-f009610509c8 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:07.981760 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:08.022709 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6982def-e75e-418d-b1f6-f009610509c8 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:08.056121 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247befd7-7d26-49b7-a7c6-26e0c16d53fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:08.056716 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247befd7-7d26-49b7-a7c6-26e0c16d53fd None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:08.056995 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247befd7-7d26-49b7-a7c6-26e0c16d53fd None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:08.057272 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247befd7-7d26-49b7-a7c6-26e0c16d53fd None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:08.057904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247befd7-7d26-49b7-a7c6-26e0c16d53fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:08.058217 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247befd7-7d26-49b7-a7c6-26e0c16d53fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:08.059675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247befd7-7d26-49b7-a7c6-26e0c16d53fd None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:08.071646 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 429/837] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:08.077363 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149586b8-785b-4761-aae9-87d0daacd8c3 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:08.146037 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:08.175994 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149586b8-785b-4761-aae9-87d0daacd8c3 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:08.208739 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1bcef-fc4e-468f-9311-aacf66f35598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:08.209359 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1bcef-fc4e-468f-9311-aacf66f35598 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:08.209649 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1bcef-fc4e-468f-9311-aacf66f35598 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:08.209904 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1bcef-fc4e-468f-9311-aacf66f35598 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:08.216236 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1bcef-fc4e-468f-9311-aacf66f35598 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:08.217651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1bcef-fc4e-468f-9311-aacf66f35598 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:08.229033 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-80b1bcef-fc4e-468f-9311-aacf66f35598 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:15:08.229033 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:08.229033 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:08.229033 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:08.229033 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:08.229033 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:08.229033 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:08.229033 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:08.229033 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:08.229033 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:08.229033 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:08.229033 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:08.229033 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:15:08.229033 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:15:08.229033 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:15:08.230140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:15:08.230140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:08.230140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:08.230140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:08.230140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:08.230140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:08.230140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:08.230140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:08.230140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:08.230140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:08.230140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:08.230140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:08.230140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:08.230140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:08.230140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:08.230140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:08.230140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:08.231116 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:15:08.231116 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:15:08.231116 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:15:08.231116 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:15:08.231116 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:15:08.231116 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:15:08.231116 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:15:08.231116 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:15:08.231116 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 409/838] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:15:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:08.236011 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247befd7-7d26-49b7-a7c6-26e0c16d53fd None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:08.334979 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247befd7-7d26-49b7-a7c6-26e0c16d53fd None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:08.351893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:08.368623 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b9f5f-52e7-4545-bdff-edb42e187385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:08.369215 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b9f5f-52e7-4545-bdff-edb42e187385 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:08.369490 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b9f5f-52e7-4545-bdff-edb42e187385 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:08.369753 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b9f5f-52e7-4545-bdff-edb42e187385 None admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:08.370423 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b9f5f-52e7-4545-bdff-edb42e187385 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:08.370751 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b9f5f-52e7-4545-bdff-edb42e187385 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:08.372170 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b9f5f-52e7-4545-bdff-edb42e187385 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:08.383637 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 430/839] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:15:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:08.389868 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1bcef-fc4e-468f-9311-aacf66f35598 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:08.491652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1bcef-fc4e-468f-9311-aacf66f35598 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:08.518284 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:08.524128 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa8b04-2c61-41c8-b375-e68548d51958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:08.524719 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa8b04-2c61-41c8-b375-e68548d51958 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:08.524992 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa8b04-2c61-41c8-b375-e68548d51958 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:08.525260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa8b04-2c61-41c8-b375-e68548d51958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:08.525962 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa8b04-2c61-41c8-b375-e68548d51958 None admin] RBAC: Adding query filter params (role.id=1201f07f50a74488936b4eba2ba9a82c, scope.project.id=409a043500554125a93c4636db5a6812, user.id=4aab18dc39cf4d119ba5f07fda334ec1) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:08.526263 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa8b04-2c61-41c8-b375-e68548d51958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:08.527748 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa8b04-2c61-41c8-b375-e68548d51958 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:08.532947 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 410/840] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:15:08 2022] GET /identity/v3/role_assignments?user.id=4aab18dc39cf4d119ba5f07fda334ec1&scope.project.id=409a043500554125a93c4636db5a6812&role.id=1201f07f50a74488936b4eba2ba9a82c => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:10.709292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae06af-8eae-4203-ac3e-c808c0a79097 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:10.709809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae06af-8eae-4203-ac3e-c808c0a79097 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:10.709931 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae06af-8eae-4203-ac3e-c808c0a79097 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:10.711203 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 431/841] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:15:10.716470 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a70fc9-93df-4c89-a836-6e07bf8ba937 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:10.716887 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a70fc9-93df-4c89-a836-6e07bf8ba937 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:10.716994 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a70fc9-93df-4c89-a836-6e07bf8ba937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:10.735348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-93a70fc9-93df-4c89-a836-6e07bf8ba937 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:15:10.736513 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-93a70fc9-93df-4c89-a836-6e07bf8ba937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:15:10.802908 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 411/842] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:15:10 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 19:15:11.130121 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae06af-8eae-4203-ac3e-c808c0a79097 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:11.232070 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae06af-8eae-4203-ac3e-c808c0a79097 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:11.265530 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ce0ac-c2dc-496c-81ee-63ac4f38c909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:11.266245 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ce0ac-c2dc-496c-81ee-63ac4f38c909 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:11.266548 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ce0ac-c2dc-496c-81ee-63ac4f38c909 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:11.266816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ce0ac-c2dc-496c-81ee-63ac4f38c909 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:11.277436 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ce0ac-c2dc-496c-81ee-63ac4f38c909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:15:11.282056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-391ce0ac-c2dc-496c-81ee-63ac4f38c909 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:15:11.282056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:11.282056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:11.282056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:11.282056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:11.282056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:11.282056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:11.282056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:11.282056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:11.282056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:11.282056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:11.282056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:11.282056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:15:11.282056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:15:11.282056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:15:11.282056 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:15:11.283191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:15:11.283191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:15:11.283191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:15:11.283191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:15:11.283191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:11.283191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:11.283191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:11.283191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:11.283191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:11.283191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:11.283191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:11.283191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:11.283191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:11.283191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:11.283191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:11.283191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:11.284860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:11.284860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:11.284860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:11.284860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:11.284860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:15:11.284860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:15:11.284860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:15:11.284860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:15:11.284860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:15:11.284860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:15:11.284860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:15:11.284860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:11.284860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 432/843] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Aug 19 19:15:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:11.290021 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a70fc9-93df-4c89-a836-6e07bf8ba937 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:11.387973 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a70fc9-93df-4c89-a836-6e07bf8ba937 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:11.411480 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:11.421918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efa230-c115-48a0-aeb7-c8f556b863a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:11.422587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efa230-c115-48a0-aeb7-c8f556b863a0 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:11.422872 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efa230-c115-48a0-aeb7-c8f556b863a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:11.423147 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efa230-c115-48a0-aeb7-c8f556b863a0 None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:11.423814 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efa230-c115-48a0-aeb7-c8f556b863a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:11.424118 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efa230-c115-48a0-aeb7-c8f556b863a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:11.425653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efa230-c115-48a0-aeb7-c8f556b863a0 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:11.433934 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 412/844] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Aug 19 19:15:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:11.440043 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ce0ac-c2dc-496c-81ee-63ac4f38c909 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:11.481054 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:11.539389 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ce0ac-c2dc-496c-81ee-63ac4f38c909 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:11.574680 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59f532-2c5f-4ca4-bdee-729474b3102e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:11.575644 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59f532-2c5f-4ca4-bdee-729474b3102e None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:11.575644 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59f532-2c5f-4ca4-bdee-729474b3102e None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:11.575821 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59f532-2c5f-4ca4-bdee-729474b3102e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:11.586462 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59f532-2c5f-4ca4-bdee-729474b3102e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:11.587929 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59f532-2c5f-4ca4-bdee-729474b3102e None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:11.602047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-df59f532-2c5f-4ca4-bdee-729474b3102e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:11.602047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:11.602047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:11.602047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:11.602047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:11.602047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:11.602047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:11.602047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:11.602047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:11.602047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:11.602047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:11.602047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:11.602047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:15:11.602047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:15:11.602047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:15:11.602047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:15:11.603164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:11.603164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:11.603164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:11.603164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:11.603164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:11.603164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:11.603164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:11.603164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:11.603164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:11.603164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:11.603164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:11.603164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:11.603164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:11.603164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:11.603164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:11.603164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:11.603164 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:15:11.604434 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:15:11.604434 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:11.604434 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:11.604434 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 433/845] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:11.608940 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efa230-c115-48a0-aeb7-c8f556b863a0 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:11.708586 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efa230-c115-48a0-aeb7-c8f556b863a0 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:11.741766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2188f-9b65-4170-9ee9-f7230000a25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:11.742364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2188f-9b65-4170-9ee9-f7230000a25c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:11.742659 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2188f-9b65-4170-9ee9-f7230000a25c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:11.742933 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2188f-9b65-4170-9ee9-f7230000a25c None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:11.743598 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2188f-9b65-4170-9ee9-f7230000a25c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:11.743923 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2188f-9b65-4170-9ee9-f7230000a25c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:11.745274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2188f-9b65-4170-9ee9-f7230000a25c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:11.757568 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 413/846] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:11.763413 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59f532-2c5f-4ca4-bdee-729474b3102e None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:11.854676 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:11.864786 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59f532-2c5f-4ca4-bdee-729474b3102e None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:11.897517 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5100f6-e834-456e-a5da-51834a2970eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:11.898135 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5100f6-e834-456e-a5da-51834a2970eb None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:11.898413 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5100f6-e834-456e-a5da-51834a2970eb None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:11.898701 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5100f6-e834-456e-a5da-51834a2970eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:11.906175 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5100f6-e834-456e-a5da-51834a2970eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:11.907634 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5100f6-e834-456e-a5da-51834a2970eb None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:11.918574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-ab5100f6-e834-456e-a5da-51834a2970eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:15:11.918574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:11.918574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:11.918574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:11.918574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:11.918574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:11.918574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:11.918574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:11.918574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:11.918574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:11.918574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:11.918574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:11.918574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:15:11.918574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:15:11.918574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:15:11.918574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:15:11.919744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:11.919744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:11.919744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:15:11.919744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:15:11.919744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:15:11.919744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:15:11.919744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:11.919744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:11.919744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:11.919744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:11.919744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:11.919744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:11.919744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:11.919744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:11.919744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:11.919744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:11.919744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:11.919744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:11.920994 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:11.920994 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:11.920994 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:15:11.920994 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:15:11.920994 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:15:11.920994 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:15:11.920994 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:15:11.920994 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:15:11.920994 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:15:11.920994 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:11.920994 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 434/847] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:11.926155 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2188f-9b65-4170-9ee9-f7230000a25c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:11.975202 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:12.025684 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2188f-9b65-4170-9ee9-f7230000a25c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:12.058278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca3d19-6362-414b-8f5f-b787ccf6e847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:12.058894 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca3d19-6362-414b-8f5f-b787ccf6e847 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:12.059169 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca3d19-6362-414b-8f5f-b787ccf6e847 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:12.059437 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca3d19-6362-414b-8f5f-b787ccf6e847 None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:12.060143 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca3d19-6362-414b-8f5f-b787ccf6e847 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:12.060445 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca3d19-6362-414b-8f5f-b787ccf6e847 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:12.061844 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca3d19-6362-414b-8f5f-b787ccf6e847 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:12.079875 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 414/848] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Aug 19 19:15:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:12.085695 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5100f6-e834-456e-a5da-51834a2970eb None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:12.185618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5100f6-e834-456e-a5da-51834a2970eb None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:12.218512 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fcf83c-7a16-43a8-a5f3-f0806a9d7669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:12.219157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fcf83c-7a16-43a8-a5f3-f0806a9d7669 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:12.219437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fcf83c-7a16-43a8-a5f3-f0806a9d7669 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:12.219709 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fcf83c-7a16-43a8-a5f3-f0806a9d7669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:12.230761 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fcf83c-7a16-43a8-a5f3-f0806a9d7669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:12.232137 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fcf83c-7a16-43a8-a5f3-f0806a9d7669 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:12.246576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-f7fcf83c-7a16-43a8-a5f3-f0806a9d7669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:12.246576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:12.246576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:12.246576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:12.246576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:12.246576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:12.246576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:12.246576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:12.246576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:12.246576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:12.246576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:12.246576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:12.246576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:15:12.246576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:15:12.246576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:15:12.246576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:15:12.249333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:12.249333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:12.249333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:12.249333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:12.249333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:12.249333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:12.249333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:12.249333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:12.249333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:12.249333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:12.249333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:12.249333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:12.249333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:12.249333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:12.249333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:12.249333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:12.249333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:15:12.251023 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:15:12.251023 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:12.251023 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:12.251023 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 435/849] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:12.253572 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca3d19-6362-414b-8f5f-b787ccf6e847 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:12.352318 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca3d19-6362-414b-8f5f-b787ccf6e847 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:12.354625 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:12.385524 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c518f-913d-48e0-9101-9b3ac5b283fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:12.386123 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c518f-913d-48e0-9101-9b3ac5b283fe None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:12.386396 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c518f-913d-48e0-9101-9b3ac5b283fe None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:12.386695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c518f-913d-48e0-9101-9b3ac5b283fe None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:12.387324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c518f-913d-48e0-9101-9b3ac5b283fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:12.387652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c518f-913d-48e0-9101-9b3ac5b283fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:12.389012 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c518f-913d-48e0-9101-9b3ac5b283fe None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:12.399701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 415/850] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:12.405441 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fcf83c-7a16-43a8-a5f3-f0806a9d7669 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:12.408323 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:12.504313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fcf83c-7a16-43a8-a5f3-f0806a9d7669 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:12.537918 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832ecf6-28bb-41b5-909a-9207fdfc9ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:12.538558 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832ecf6-28bb-41b5-909a-9207fdfc9ecb None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:12.538842 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832ecf6-28bb-41b5-909a-9207fdfc9ecb None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:12.539110 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832ecf6-28bb-41b5-909a-9207fdfc9ecb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:12.545549 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832ecf6-28bb-41b5-909a-9207fdfc9ecb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:12.547023 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832ecf6-28bb-41b5-909a-9207fdfc9ecb None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:12.557930 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-6832ecf6-28bb-41b5-909a-9207fdfc9ecb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:15:12.557930 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:12.557930 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:12.557930 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:12.557930 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:12.557930 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:12.557930 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:12.557930 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:12.557930 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:12.557930 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:12.557930 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:12.557930 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:12.557930 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:15:12.557930 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:15:12.557930 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:15:12.559828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:15:12.559828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:12.559828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:12.559828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:12.559828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:12.559828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:12.559828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:12.559828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:12.559828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:12.559828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:12.559828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:12.559828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:12.559828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:12.559828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:12.559828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:12.559828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:12.559828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:12.560757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:15:12.560757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:15:12.560757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:15:12.560757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:15:12.560757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:15:12.560757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:15:12.560757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:15:12.560757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:12.560757 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 436/851] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:15:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:12.565194 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c518f-913d-48e0-9101-9b3ac5b283fe None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:12.665108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c518f-913d-48e0-9101-9b3ac5b283fe None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:12.699412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61272ffb-0c71-4049-beaf-56ad8c4f73f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:12.700022 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61272ffb-0c71-4049-beaf-56ad8c4f73f4 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:12.700304 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61272ffb-0c71-4049-beaf-56ad8c4f73f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:12.700577 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61272ffb-0c71-4049-beaf-56ad8c4f73f4 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:12.701260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61272ffb-0c71-4049-beaf-56ad8c4f73f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:12.701566 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61272ffb-0c71-4049-beaf-56ad8c4f73f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:12.703022 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61272ffb-0c71-4049-beaf-56ad8c4f73f4 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:12.715454 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 416/852] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:15:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:12.721410 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832ecf6-28bb-41b5-909a-9207fdfc9ecb None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:12.781520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:12.821868 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832ecf6-28bb-41b5-909a-9207fdfc9ecb None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:12.855736 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2086432-7d11-4c17-beca-e9a04fd8e286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:12.856389 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2086432-7d11-4c17-beca-e9a04fd8e286 None admin] REQUEST_METHOD: `PUT` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:12.856670 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2086432-7d11-4c17-beca-e9a04fd8e286 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:12.856940 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2086432-7d11-4c17-beca-e9a04fd8e286 None admin] PATH_INFO: `/v3/projects/409a043500554125a93c4636db5a6812/users/4aab18dc39cf4d119ba5f07fda334ec1/roles/1201f07f50a74488936b4eba2ba9a82c` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:12.871457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2086432-7d11-4c17-beca-e9a04fd8e286 None admin] RBAC: Authorizing `identity:create_grant(project_id=409a043500554125a93c4636db5a6812, user_id=4aab18dc39cf4d119ba5f07fda334ec1, role_id=1201f07f50a74488936b4eba2ba9a82c)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:12.872926 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2086432-7d11-4c17-beca-e9a04fd8e286 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:12.942187 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 437/853] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Aug 19 19:15:12 2022] PUT /identity/v3/projects/409a043500554125a93c4636db5a6812/users/4aab18dc39cf4d119ba5f07fda334ec1/roles/1201f07f50a74488936b4eba2ba9a82c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:15:15.124070 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e2d45-df78-469b-9187-d67e86d72e08 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:15.124640 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e2d45-df78-469b-9187-d67e86d72e08 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:15.124640 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e2d45-df78-469b-9187-d67e86d72e08 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:15.126004 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 417/854] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:15:15.132040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba29f01-cd7c-4223-8d47-3f3baac21820 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:15.132426 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba29f01-cd7c-4223-8d47-3f3baac21820 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:15.132583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba29f01-cd7c-4223-8d47-3f3baac21820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:15.150554 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-fba29f01-cd7c-4223-8d47-3f3baac21820 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:15:15.151732 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-fba29f01-cd7c-4223-8d47-3f3baac21820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:15:15.216952 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 438/855] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:15:15 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:15:15.551490 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e2d45-df78-469b-9187-d67e86d72e08 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:15.577292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:15.653012 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e2d45-df78-469b-9187-d67e86d72e08 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:15.686012 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c956ea-e724-41de-a259-f4aaad3adac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:15.686756 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c956ea-e724-41de-a259-f4aaad3adac7 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:15.687030 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c956ea-e724-41de-a259-f4aaad3adac7 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:15.687296 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c956ea-e724-41de-a259-f4aaad3adac7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:15.697791 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c956ea-e724-41de-a259-f4aaad3adac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:15:15.702567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-06c956ea-e724-41de-a259-f4aaad3adac7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:15:15.702567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:15.702567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:15.702567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:15.702567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:15.702567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:15.702567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:15.702567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:15.702567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:15.702567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:15.702567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:15.702567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:15.702567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:15:15.702567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:15:15.702567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:15:15.702567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:15:15.703699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:15:15.703699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:15:15.703699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:15:15.703699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:15:15.703699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:15.703699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:15.703699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:15.703699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:15.703699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:15.703699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:15.703699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:15.703699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:15.703699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:15.703699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:15.703699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:15.703699 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:15.704849 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:15.704849 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:15.704849 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:15.704849 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:15.704849 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:15:15.704849 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:15:15.704849 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:15:15.704849 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:15:15.704849 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:15:15.704849 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:15:15.704849 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 19:15:15.704849 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:15:15.704849 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 418/856] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Aug 19 19:15:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:15.710373 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba29f01-cd7c-4223-8d47-3f3baac21820 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:15.753482 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:15.807822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba29f01-cd7c-4223-8d47-3f3baac21820 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:15.841854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121a674-3232-4489-a1b8-d0b3563054f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:15.842459 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121a674-3232-4489-a1b8-d0b3563054f8 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:15.842767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121a674-3232-4489-a1b8-d0b3563054f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:15.843040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121a674-3232-4489-a1b8-d0b3563054f8 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:15.843698 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121a674-3232-4489-a1b8-d0b3563054f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:15.844000 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121a674-3232-4489-a1b8-d0b3563054f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:15.845366 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121a674-3232-4489-a1b8-d0b3563054f8 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:15.853534 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 439/857] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Aug 19 19:15:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:15.859599 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c956ea-e724-41de-a259-f4aaad3adac7 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:15.945405 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:15.960470 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c956ea-e724-41de-a259-f4aaad3adac7 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:15.993424 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe006f-82c1-4696-9ee0-91f001f87683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:15.994046 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe006f-82c1-4696-9ee0-91f001f87683 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:15.994320 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe006f-82c1-4696-9ee0-91f001f87683 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:15.994626 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe006f-82c1-4696-9ee0-91f001f87683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:16.004853 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe006f-82c1-4696-9ee0-91f001f87683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:16.006298 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe006f-82c1-4696-9ee0-91f001f87683 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:16.019825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-5ffe006f-82c1-4696-9ee0-91f001f87683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:16.019825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:16.019825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:16.019825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:16.019825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:16.019825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:16.019825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:16.019825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:16.019825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:16.019825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:16.019825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:16.019825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:16.019825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:15:16.019825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:15:16.019825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:15:16.019825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:15:16.020881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:16.020881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:16.020881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:16.020881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:16.020881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:16.020881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:16.020881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:16.020881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:16.020881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:16.020881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:16.020881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:16.020881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:16.020881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:16.020881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:16.020881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:16.020881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:16.020881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:15:16.021961 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:15:16.021961 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:16.021961 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:15:16.022663 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 419/858] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 19:15:16.026856 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121a674-3232-4489-a1b8-d0b3563054f8 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:16.125767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121a674-3232-4489-a1b8-d0b3563054f8 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:16.157802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77213a95-077a-420a-bad9-632d718c0849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:16.158429 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77213a95-077a-420a-bad9-632d718c0849 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:16.158694 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77213a95-077a-420a-bad9-632d718c0849 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:16.159506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77213a95-077a-420a-bad9-632d718c0849 None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:16.160185 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77213a95-077a-420a-bad9-632d718c0849 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:16.160487 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77213a95-077a-420a-bad9-632d718c0849 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:16.161841 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77213a95-077a-420a-bad9-632d718c0849 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:16.173221 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 440/859] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:16.179488 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe006f-82c1-4696-9ee0-91f001f87683 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:16.193951 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:16.280344 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe006f-82c1-4696-9ee0-91f001f87683 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:16.313077 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e47e5-de8c-4cde-a962-973cd167cb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:16.313960 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e47e5-de8c-4cde-a962-973cd167cb19 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:16.314235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e47e5-de8c-4cde-a962-973cd167cb19 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:16.314505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e47e5-de8c-4cde-a962-973cd167cb19 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:16.317303 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:16.322888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e47e5-de8c-4cde-a962-973cd167cb19 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:16.324329 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e47e5-de8c-4cde-a962-973cd167cb19 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:16.335752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-b94e47e5-de8c-4cde-a962-973cd167cb19 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:15:16.335752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:16.335752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:16.335752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:16.335752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:16.335752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:16.335752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:16.335752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:16.335752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:16.335752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:16.335752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:16.335752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:16.335752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:15:16.335752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:15:16.335752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:15:16.335752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:15:16.336888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:16.336888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:16.336888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:15:16.336888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:15:16.336888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:15:16.336888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:15:16.336888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:16.336888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:16.336888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:16.336888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:16.336888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:16.336888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:16.336888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:16.336888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:16.336888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:16.336888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:16.336888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:16.336888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:16.338170 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:16.338170 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:16.338170 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:15:16.338170 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:15:16.338170 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:15:16.338170 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:15:16.338170 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:15:16.338170 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:15:16.338170 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:15:16.338170 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:15:16.338170 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 420/860] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:16.342848 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77213a95-077a-420a-bad9-632d718c0849 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:16.442908 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77213a95-077a-420a-bad9-632d718c0849 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:16.477460 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4caccd-ef0b-466b-92e7-fa17969636df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:16.478059 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4caccd-ef0b-466b-92e7-fa17969636df None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:16.478340 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4caccd-ef0b-466b-92e7-fa17969636df None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:16.478641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4caccd-ef0b-466b-92e7-fa17969636df None admin] PATH_INFO: `/v3/users` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:16.479361 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4caccd-ef0b-466b-92e7-fa17969636df None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:16.479665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4caccd-ef0b-466b-92e7-fa17969636df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:16.481085 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4caccd-ef0b-466b-92e7-fa17969636df None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:16.498076 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 441/861] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Aug 19 19:15:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:16.503997 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e47e5-de8c-4cde-a962-973cd167cb19 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:16.605981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e47e5-de8c-4cde-a962-973cd167cb19 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:16.639599 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8f741-47a7-432b-89de-d09c65c6f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:16.640196 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8f741-47a7-432b-89de-d09c65c6f2bc None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:16.640472 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8f741-47a7-432b-89de-d09c65c6f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:16.640748 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8f741-47a7-432b-89de-d09c65c6f2bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:16.701037 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:16.707934 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8f741-47a7-432b-89de-d09c65c6f2bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:16.709386 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8f741-47a7-432b-89de-d09c65c6f2bc None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:16.803594 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 421/862] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:15:16 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 19:15:16.809196 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4caccd-ef0b-466b-92e7-fa17969636df None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:16.834712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:16.911311 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4caccd-ef0b-466b-92e7-fa17969636df None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:16.945894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b6feb-65d2-417e-b917-f95ea4253961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:16.946510 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b6feb-65d2-417e-b917-f95ea4253961 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:16.946817 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b6feb-65d2-417e-b917-f95ea4253961 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:16.947088 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b6feb-65d2-417e-b917-f95ea4253961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:16.957089 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b6feb-65d2-417e-b917-f95ea4253961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:16.958457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b6feb-65d2-417e-b917-f95ea4253961 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:16.972780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-128b6feb-65d2-417e-b917-f95ea4253961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:16.972780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:16.972780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:16.972780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:16.972780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:16.972780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:16.972780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:16.972780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:16.972780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:16.972780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:16.972780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:16.972780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:16.972780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:15:16.972780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:15:16.972780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:15:16.972780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:15:16.973893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:16.973893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:16.973893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:16.973893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:16.973893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:16.973893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:16.973893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:16.973893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:16.973893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:16.973893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:16.973893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:16.973893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:16.973893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:16.973893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:16.973893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:16.973893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:16.973893 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:15:16.974891 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:15:16.974891 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:16.974891 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:16.974891 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 442/863] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:16.979859 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8f741-47a7-432b-89de-d09c65c6f2bc None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:17.073224 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:17.078856 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8f741-47a7-432b-89de-d09c65c6f2bc None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:17.112590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7211f1-1f9c-491f-b903-9aa4ca2e98b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:17.113203 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7211f1-1f9c-491f-b903-9aa4ca2e98b9 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:17.113486 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7211f1-1f9c-491f-b903-9aa4ca2e98b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:17.113756 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7211f1-1f9c-491f-b903-9aa4ca2e98b9 None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:17.114390 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7211f1-1f9c-491f-b903-9aa4ca2e98b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:17.114723 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7211f1-1f9c-491f-b903-9aa4ca2e98b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:17.116225 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7211f1-1f9c-491f-b903-9aa4ca2e98b9 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:17.127333 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 422/864] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:17.133813 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b6feb-65d2-417e-b917-f95ea4253961 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:17.208724 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:17.232657 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b6feb-65d2-417e-b917-f95ea4253961 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:17.266193 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1039927-95c9-4e2a-aa57-7ad7a37569cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:17.266841 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1039927-95c9-4e2a-aa57-7ad7a37569cd None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:17.267151 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1039927-95c9-4e2a-aa57-7ad7a37569cd None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:17.267425 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1039927-95c9-4e2a-aa57-7ad7a37569cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:17.273819 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1039927-95c9-4e2a-aa57-7ad7a37569cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:17.275475 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1039927-95c9-4e2a-aa57-7ad7a37569cd None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:17.287009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-f1039927-95c9-4e2a-aa57-7ad7a37569cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:15:17.287009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:17.287009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:17.287009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:17.287009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:17.287009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:17.287009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:17.287009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:17.287009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:17.287009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:17.287009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:17.287009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:17.287009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:15:17.287009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:15:17.287009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:15:17.288040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:15:17.288040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:17.288040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:17.288040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:17.288040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:17.288040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:17.288040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:17.288040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:17.288040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:17.288040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:17.288040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:17.288040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:17.288040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:17.288040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:17.288040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:17.288040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:17.288040 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:17.289033 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:15:17.289033 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:15:17.289033 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:15:17.289033 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:15:17.289033 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:15:17.289033 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:15:17.289033 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:15:17.289033 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:17.289033 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 443/865] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:15:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:17.294144 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7211f1-1f9c-491f-b903-9aa4ca2e98b9 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:17.393605 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7211f1-1f9c-491f-b903-9aa4ca2e98b9 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:17.427835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d57e35-b15a-44c4-ba58-93b460bf8de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:17.428435 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d57e35-b15a-44c4-ba58-93b460bf8de4 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:17.428710 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d57e35-b15a-44c4-ba58-93b460bf8de4 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:17.428979 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d57e35-b15a-44c4-ba58-93b460bf8de4 None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:17.429659 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d57e35-b15a-44c4-ba58-93b460bf8de4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:17.429962 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d57e35-b15a-44c4-ba58-93b460bf8de4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:17.431409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d57e35-b15a-44c4-ba58-93b460bf8de4 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:17.443720 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 423/866] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:15:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:17.449917 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1039927-95c9-4e2a-aa57-7ad7a37569cd None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:17.546822 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1039927-95c9-4e2a-aa57-7ad7a37569cd None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:17.584165 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae5222-77d7-4587-b4ad-b36663ed1695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:17.584769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae5222-77d7-4587-b4ad-b36663ed1695 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:17.585046 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae5222-77d7-4587-b4ad-b36663ed1695 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:17.585316 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae5222-77d7-4587-b4ad-b36663ed1695 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:17.586027 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae5222-77d7-4587-b4ad-b36663ed1695 None admin] RBAC: Adding query filter params (role.id=1201f07f50a74488936b4eba2ba9a82c, scope.project.id=409a043500554125a93c4636db5a6812, user.id=4aab18dc39cf4d119ba5f07fda334ec1) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:17.586332 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae5222-77d7-4587-b4ad-b36663ed1695 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:17.587792 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae5222-77d7-4587-b4ad-b36663ed1695 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:17.589512 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:17.593814 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 444/867] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:15:17 2022] GET /identity/v3/role_assignments?user.id=4aab18dc39cf4d119ba5f07fda334ec1&scope.project.id=409a043500554125a93c4636db5a6812&role.id=1201f07f50a74488936b4eba2ba9a82c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:19.837056 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e82c86-1c16-439d-9ed0-eb162767a006 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:19.837651 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e82c86-1c16-439d-9ed0-eb162767a006 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:19.837767 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e82c86-1c16-439d-9ed0-eb162767a006 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:19.839366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 424/868] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:15:19.844464 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b338352-826d-4ca2-b8e8-e97b68699f03 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:19.844871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b338352-826d-4ca2-b8e8-e97b68699f03 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:19.845010 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b338352-826d-4ca2-b8e8-e97b68699f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:19.864636 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-1b338352-826d-4ca2-b8e8-e97b68699f03 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:15:19.865802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-1b338352-826d-4ca2-b8e8-e97b68699f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:15:19.933785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 445/869] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:15:19 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:15:20.266201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e82c86-1c16-439d-9ed0-eb162767a006 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:20.284861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:20.376346 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e82c86-1c16-439d-9ed0-eb162767a006 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:20.411101 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea62d9e-a4b7-40d7-9c85-872c85180e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:20.411767 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea62d9e-a4b7-40d7-9c85-872c85180e27 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:20.412035 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea62d9e-a4b7-40d7-9c85-872c85180e27 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:20.412299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea62d9e-a4b7-40d7-9c85-872c85180e27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:20.422070 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea62d9e-a4b7-40d7-9c85-872c85180e27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:15:20.426709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-9ea62d9e-a4b7-40d7-9c85-872c85180e27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:15:20.426709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:20.426709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:20.426709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:20.426709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:20.426709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:20.426709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:20.426709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:20.426709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:20.426709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:20.426709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:20.426709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:20.426709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:15:20.426709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:15:20.426709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:15:20.426709 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:15:20.427931 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:15:20.427931 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:15:20.427931 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:15:20.427931 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:15:20.427931 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:20.427931 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:20.427931 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:20.427931 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:20.427931 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:20.427931 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:20.427931 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:20.427931 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:20.427931 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:20.427931 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:20.427931 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:20.427931 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:20.428951 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:20.428951 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:20.428951 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:20.428951 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:20.428951 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:15:20.428951 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:15:20.428951 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:15:20.428951 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:15:20.428951 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:15:20.428951 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:15:20.428951 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:15:20.428951 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:15:20.428951 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 425/870] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Aug 19 19:15:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:20.434208 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b338352-826d-4ca2-b8e8-e97b68699f03 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:20.532468 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b338352-826d-4ca2-b8e8-e97b68699f03 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:20.558591 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:20.567119 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b0cf6-b66b-4fd2-ae9f-49d13301b69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:20.567725 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b0cf6-b66b-4fd2-ae9f-49d13301b69d None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:20.568005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b0cf6-b66b-4fd2-ae9f-49d13301b69d None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:20.568279 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b0cf6-b66b-4fd2-ae9f-49d13301b69d None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:20.568950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b0cf6-b66b-4fd2-ae9f-49d13301b69d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:20.569248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b0cf6-b66b-4fd2-ae9f-49d13301b69d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:20.570651 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b0cf6-b66b-4fd2-ae9f-49d13301b69d None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:20.578922 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 446/871] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:15:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:20.585605 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea62d9e-a4b7-40d7-9c85-872c85180e27 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:20.676342 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:20.698958 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea62d9e-a4b7-40d7-9c85-872c85180e27 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:20.731727 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3f670-31dc-43d6-a4ba-a931d4e2e12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:20.732355 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3f670-31dc-43d6-a4ba-a931d4e2e12c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:20.732631 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3f670-31dc-43d6-a4ba-a931d4e2e12c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:20.732902 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3f670-31dc-43d6-a4ba-a931d4e2e12c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:20.744392 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3f670-31dc-43d6-a4ba-a931d4e2e12c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:20.745836 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3f670-31dc-43d6-a4ba-a931d4e2e12c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:20.760243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-23f3f670-31dc-43d6-a4ba-a931d4e2e12c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:20.760243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:20.760243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:20.760243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:20.760243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:20.760243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:20.760243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:20.760243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:20.760243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:20.760243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:20.760243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:20.760243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:20.760243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:15:20.760243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:15:20.760243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:15:20.760243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:15:20.763505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:20.763505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:20.763505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:20.763505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:20.763505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:20.763505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:20.763505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:20.763505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:20.763505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:20.763505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:20.763505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:20.763505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:20.763505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:20.763505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:20.763505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:20.763505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:20.763505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:15:20.764581 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:15:20.764581 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:20.764581 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:15:20.764581 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 426/872] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:20.767365 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b0cf6-b66b-4fd2-ae9f-49d13301b69d None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:20.867118 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b0cf6-b66b-4fd2-ae9f-49d13301b69d None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:20.900566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c2a9f-ad40-474a-9a82-d782bc420372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:20.901180 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c2a9f-ad40-474a-9a82-d782bc420372 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:20.901460 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c2a9f-ad40-474a-9a82-d782bc420372 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:20.901733 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c2a9f-ad40-474a-9a82-d782bc420372 None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:20.902374 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c2a9f-ad40-474a-9a82-d782bc420372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:20.902726 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c2a9f-ad40-474a-9a82-d782bc420372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:20.908509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c2a9f-ad40-474a-9a82-d782bc420372 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:20.916098 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 447/873] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:20.921930 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3f670-31dc-43d6-a4ba-a931d4e2e12c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:21.022074 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3f670-31dc-43d6-a4ba-a931d4e2e12c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:21.046787 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:21.054574 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3ee4b-0afb-456c-b65a-a4ddb7af752c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:21.055197 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3ee4b-0afb-456c-b65a-a4ddb7af752c None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:21.055471 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3ee4b-0afb-456c-b65a-a4ddb7af752c None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:21.055767 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3ee4b-0afb-456c-b65a-a4ddb7af752c None admin] PATH_INFO: `/v3/users/placement` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:21.062835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3ee4b-0afb-456c-b65a-a4ddb7af752c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:21.064512 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3ee4b-0afb-456c-b65a-a4ddb7af752c None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:21.075656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-aed3ee4b-0afb-456c-b65a-a4ddb7af752c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:15:21.075656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:21.075656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:21.075656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:21.075656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:21.075656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:21.075656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:21.075656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:21.075656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:21.075656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:21.075656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:21.075656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:21.075656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:15:21.075656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:15:21.075656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:15:21.075656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:15:21.081038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:21.081038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:21.081038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:15:21.081038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:15:21.081038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:15:21.081038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:15:21.081038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:21.081038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:21.081038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:21.081038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:21.081038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:21.081038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:21.081038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:21.081038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:21.081038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:21.081038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:21.081038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:21.081038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:21.082184 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:21.082184 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:21.082184 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:15:21.082184 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:15:21.082184 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:15:21.082184 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:15:21.082184 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:15:21.082184 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:15:21.082184 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:15:21.082184 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:15:21.082184 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 427/874] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:21.083068 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c2a9f-ad40-474a-9a82-d782bc420372 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:21.132904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:21.181770 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c2a9f-ad40-474a-9a82-d782bc420372 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:21.216048 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ddd6d-5283-475b-88af-865dcd08cf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:21.216648 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ddd6d-5283-475b-88af-865dcd08cf04 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:21.216932 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ddd6d-5283-475b-88af-865dcd08cf04 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:21.217182 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ddd6d-5283-475b-88af-865dcd08cf04 None admin] PATH_INFO: `/v3/users` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:21.217898 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ddd6d-5283-475b-88af-865dcd08cf04 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:21.218198 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ddd6d-5283-475b-88af-865dcd08cf04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:21.219640 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ddd6d-5283-475b-88af-865dcd08cf04 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:21.237979 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 448/875] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Aug 19 19:15:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:21.243802 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3ee4b-0afb-456c-b65a-a4ddb7af752c None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:21.341570 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3ee4b-0afb-456c-b65a-a4ddb7af752c None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:21.376071 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bd784-c41b-459e-99cf-a10cb1e5b82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:21.376673 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bd784-c41b-459e-99cf-a10cb1e5b82d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:21.376950 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bd784-c41b-459e-99cf-a10cb1e5b82d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:21.377223 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bd784-c41b-459e-99cf-a10cb1e5b82d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:21.433287 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:21.445206 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bd784-c41b-459e-99cf-a10cb1e5b82d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:21.446690 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bd784-c41b-459e-99cf-a10cb1e5b82d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:21.544192 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 428/876] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:15:21 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 19:15:21.550213 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ddd6d-5283-475b-88af-865dcd08cf04 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:21.649322 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ddd6d-5283-475b-88af-865dcd08cf04 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:21.658302 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:21.683106 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c444e66-5c00-4108-aafb-c7d3846f4820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:21.683777 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c444e66-5c00-4108-aafb-c7d3846f4820 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:21.684000 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c444e66-5c00-4108-aafb-c7d3846f4820 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:21.684266 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c444e66-5c00-4108-aafb-c7d3846f4820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:21.694498 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c444e66-5c00-4108-aafb-c7d3846f4820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:21.696117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c444e66-5c00-4108-aafb-c7d3846f4820 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:21.711905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-1c444e66-5c00-4108-aafb-c7d3846f4820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:21.711905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:21.711905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:21.711905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:21.711905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:21.711905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:21.711905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:21.711905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:21.711905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:21.711905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:21.711905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:21.711905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:21.711905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:15:21.711905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:15:21.711905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:15:21.711905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:15:21.713090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:21.713090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:21.713090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:21.713090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:21.713090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:21.713090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:21.713090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:21.713090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:21.713090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:21.713090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:21.713090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:21.713090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:21.713090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:21.713090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:21.713090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:21.713090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:21.713090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:15:21.714404 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:15:21.714404 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:21.714404 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:21.714404 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 449/877] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:21.718877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bd784-c41b-459e-99cf-a10cb1e5b82d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:21.815925 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:21.821974 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bd784-c41b-459e-99cf-a10cb1e5b82d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:21.854784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5720f48-9a78-4b2c-a214-82074f1a94fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:21.855377 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5720f48-9a78-4b2c-a214-82074f1a94fa None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:21.855650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5720f48-9a78-4b2c-a214-82074f1a94fa None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:21.855917 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5720f48-9a78-4b2c-a214-82074f1a94fa None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:21.856541 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5720f48-9a78-4b2c-a214-82074f1a94fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:21.856846 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5720f48-9a78-4b2c-a214-82074f1a94fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:21.858184 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5720f48-9a78-4b2c-a214-82074f1a94fa None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:21.869218 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 429/878] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:21.875224 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c444e66-5c00-4108-aafb-c7d3846f4820 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:21.978936 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c444e66-5c00-4108-aafb-c7d3846f4820 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:22.012000 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72666c-c902-498c-b8ce-1bb915fa95a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:22.012623 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72666c-c902-498c-b8ce-1bb915fa95a2 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:22.013005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72666c-c902-498c-b8ce-1bb915fa95a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:22.013282 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72666c-c902-498c-b8ce-1bb915fa95a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:22.020563 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72666c-c902-498c-b8ce-1bb915fa95a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:22.021992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72666c-c902-498c-b8ce-1bb915fa95a2 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:22.037901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-4a72666c-c902-498c-b8ce-1bb915fa95a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:15:22.037901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:22.037901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:22.037901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:22.037901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:22.037901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:22.037901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:22.037901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:22.037901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:22.037901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:22.037901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:22.037901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:22.037901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:15:22.037901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:15:22.037901 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:15:22.041271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:15:22.041271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:22.041271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:22.041271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:22.041271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:22.041271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:22.041271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:22.041271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:22.041271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:22.041271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:22.041271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:22.041271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:22.041271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:22.041271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:22.041271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:22.041271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:22.041271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:22.042631 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:15:22.042631 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:15:22.042631 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:15:22.042631 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:15:22.042631 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:15:22.042631 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:15:22.042631 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:15:22.042631 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:22.042631 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 450/879] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:15:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:22.045238 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5720f48-9a78-4b2c-a214-82074f1a94fa None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:22.148118 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5720f48-9a78-4b2c-a214-82074f1a94fa None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:22.181844 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3adae-757d-4222-a0ce-665cc1b8c07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:22.182443 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3adae-757d-4222-a0ce-665cc1b8c07d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:22.182749 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3adae-757d-4222-a0ce-665cc1b8c07d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:22.183100 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3adae-757d-4222-a0ce-665cc1b8c07d None admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:22.183775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3adae-757d-4222-a0ce-665cc1b8c07d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:22.184083 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3adae-757d-4222-a0ce-665cc1b8c07d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:22.185564 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3adae-757d-4222-a0ce-665cc1b8c07d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:22.198184 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 430/880] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:15:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:22.204534 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72666c-c902-498c-b8ce-1bb915fa95a2 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:22.227280 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:22.301876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72666c-c902-498c-b8ce-1bb915fa95a2 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:22.334768 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e2c4e-0716-462a-befc-1925690d5aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:22.335605 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e2c4e-0716-462a-befc-1925690d5aad None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:22.336016 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e2c4e-0716-462a-befc-1925690d5aad None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:22.336929 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e2c4e-0716-462a-befc-1925690d5aad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:22.337632 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e2c4e-0716-462a-befc-1925690d5aad None admin] RBAC: Adding query filter params (role.id=8fdfbc4aaf68468f89a5ae3450b8488d, scope.project.id=409a043500554125a93c4636db5a6812, user.id=4aab18dc39cf4d119ba5f07fda334ec1) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:22.337980 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e2c4e-0716-462a-befc-1925690d5aad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:22.339561 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e2c4e-0716-462a-befc-1925690d5aad None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:22.344784 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 451/881] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:15:22 2022] GET /identity/v3/role_assignments?user.id=4aab18dc39cf4d119ba5f07fda334ec1&scope.project.id=409a043500554125a93c4636db5a6812&role.id=8fdfbc4aaf68468f89a5ae3450b8488d => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:24.489062 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ea000-6ab6-47fd-a9f5-d3c4c42ae84a None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:24.489612 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ea000-6ab6-47fd-a9f5-d3c4c42ae84a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:24.489612 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ea000-6ab6-47fd-a9f5-d3c4c42ae84a None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:24.491041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 431/882] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:15:24.496466 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb975d69-4c0b-4e86-8ada-f5802db6996c None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:24.496850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb975d69-4c0b-4e86-8ada-f5802db6996c None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:24.497003 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb975d69-4c0b-4e86-8ada-f5802db6996c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:24.514735 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-fb975d69-4c0b-4e86-8ada-f5802db6996c None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:15:24.515916 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-fb975d69-4c0b-4e86-8ada-f5802db6996c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:15:24.584481 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 452/883] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:15:24 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:15:24.915008 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ea000-6ab6-47fd-a9f5-d3c4c42ae84a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:24.926674 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:25.016309 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ea000-6ab6-47fd-a9f5-d3c4c42ae84a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:25.050058 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65581578-2a6e-44f3-ae12-79d1fed56666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:25.050763 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65581578-2a6e-44f3-ae12-79d1fed56666 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:25.051062 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65581578-2a6e-44f3-ae12-79d1fed56666 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:25.051344 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65581578-2a6e-44f3-ae12-79d1fed56666 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:25.061349 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65581578-2a6e-44f3-ae12-79d1fed56666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:15:25.066701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-65581578-2a6e-44f3-ae12-79d1fed56666 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:15:25.066701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:25.066701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:25.066701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:25.066701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:25.066701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:25.066701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:25.066701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:25.066701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:25.066701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:25.066701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:25.066701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:25.066701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:15:25.066701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:15:25.066701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:15:25.066701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:15:25.071818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:15:25.071818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:15:25.071818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:15:25.071818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:15:25.071818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:25.071818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:25.071818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:25.071818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:25.071818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:25.071818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:25.071818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:25.071818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:25.071818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:25.071818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:25.071818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:25.071818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:25.072658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:25.072658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:25.072658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:25.072658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:25.072658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:15:25.072658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:15:25.072658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:15:25.072658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:15:25.072658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:15:25.072658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:15:25.072658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:15:25.072658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:15:25.072658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 432/884] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Aug 19 19:15:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:25.073928 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb975d69-4c0b-4e86-8ada-f5802db6996c None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:25.088737 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:25.170591 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb975d69-4c0b-4e86-8ada-f5802db6996c None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:25.206191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32d03f-75e2-4c6a-bc67-448b07659e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:25.206810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32d03f-75e2-4c6a-bc67-448b07659e71 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:25.207086 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32d03f-75e2-4c6a-bc67-448b07659e71 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:25.207353 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32d03f-75e2-4c6a-bc67-448b07659e71 None admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:25.208119 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32d03f-75e2-4c6a-bc67-448b07659e71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:25.208412 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32d03f-75e2-4c6a-bc67-448b07659e71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:25.209762 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32d03f-75e2-4c6a-bc67-448b07659e71 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:25.217616 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 453/885] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:15:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:25.224139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65581578-2a6e-44f3-ae12-79d1fed56666 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:25.289274 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:25.321124 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65581578-2a6e-44f3-ae12-79d1fed56666 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:25.356073 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b52f7-5c34-45ab-85ff-d6de35e1f7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:25.356701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b52f7-5c34-45ab-85ff-d6de35e1f7da None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:25.356974 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b52f7-5c34-45ab-85ff-d6de35e1f7da None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:25.357239 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b52f7-5c34-45ab-85ff-d6de35e1f7da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:25.367851 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b52f7-5c34-45ab-85ff-d6de35e1f7da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:25.369291 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b52f7-5c34-45ab-85ff-d6de35e1f7da None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:25.383975 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-d23b52f7-5c34-45ab-85ff-d6de35e1f7da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:25.383975 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:25.383975 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:25.383975 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:25.383975 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:25.383975 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:25.383975 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:25.383975 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:25.383975 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:25.383975 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:25.383975 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:25.383975 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:25.383975 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:15:25.383975 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:15:25.383975 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:15:25.383975 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:15:25.385133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:25.385133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:25.385133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:25.385133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:25.385133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:25.385133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:25.385133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:25.385133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:25.385133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:25.385133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:25.385133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:25.385133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:25.385133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:25.385133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:25.385133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:25.385133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:25.385133 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:15:25.386079 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:15:25.386079 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:25.386079 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:15:25.386079 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 433/886] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:25.390885 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32d03f-75e2-4c6a-bc67-448b07659e71 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:25.468348 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:25.491631 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32d03f-75e2-4c6a-bc67-448b07659e71 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:25.525041 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fff5ef-9207-4b11-8800-a0b5225ad63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:25.525644 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fff5ef-9207-4b11-8800-a0b5225ad63d None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:25.525896 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fff5ef-9207-4b11-8800-a0b5225ad63d None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:25.526165 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fff5ef-9207-4b11-8800-a0b5225ad63d None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:25.526835 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fff5ef-9207-4b11-8800-a0b5225ad63d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:25.527132 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fff5ef-9207-4b11-8800-a0b5225ad63d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:25.528482 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fff5ef-9207-4b11-8800-a0b5225ad63d None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:25.539905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 454/887] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:25.545815 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b52f7-5c34-45ab-85ff-d6de35e1f7da None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:25.649392 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b52f7-5c34-45ab-85ff-d6de35e1f7da None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:25.668794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:25.683592 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64674e20-5aed-4313-af7e-82632280619d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:25.684251 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64674e20-5aed-4313-af7e-82632280619d None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:25.684531 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64674e20-5aed-4313-af7e-82632280619d None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:25.684805 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64674e20-5aed-4313-af7e-82632280619d None admin] PATH_INFO: `/v3/users/placement` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:25.692453 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64674e20-5aed-4313-af7e-82632280619d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:25.693916 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64674e20-5aed-4313-af7e-82632280619d None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:25.704764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-64674e20-5aed-4313-af7e-82632280619d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:15:25.704764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:25.704764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:25.704764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:25.704764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:25.704764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:25.704764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:25.704764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:25.704764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:25.704764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:25.704764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:25.704764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:25.704764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:15:25.704764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:15:25.704764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:15:25.704764 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:15:25.706331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:25.706331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:25.706331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:15:25.706331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:15:25.706331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:15:25.706331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:15:25.706331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:25.706331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:25.706331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:25.706331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:25.706331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:25.706331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:25.706331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:25.706331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:25.706331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:25.706331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:25.706331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:25.706331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:25.707398 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:25.707398 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:25.707398 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:15:25.707398 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:15:25.707398 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:15:25.707398 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:15:25.707398 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:15:25.707398 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:15:25.707398 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:15:25.707398 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:15:25.707398 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 434/888] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:25.711854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fff5ef-9207-4b11-8800-a0b5225ad63d None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:25.813415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fff5ef-9207-4b11-8800-a0b5225ad63d None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:25.847552 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d8e55-abaf-473d-a30e-33c7f4d7e92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:25.848189 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d8e55-abaf-473d-a30e-33c7f4d7e92a None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:25.848437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d8e55-abaf-473d-a30e-33c7f4d7e92a None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:25.848710 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d8e55-abaf-473d-a30e-33c7f4d7e92a None admin] PATH_INFO: `/v3/users` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:25.849431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d8e55-abaf-473d-a30e-33c7f4d7e92a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:25.849738 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d8e55-abaf-473d-a30e-33c7f4d7e92a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:25.851194 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d8e55-abaf-473d-a30e-33c7f4d7e92a None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:25.853657 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:25.869191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 455/889] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Aug 19 19:15:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:25.874955 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64674e20-5aed-4313-af7e-82632280619d None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:25.979579 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64674e20-5aed-4313-af7e-82632280619d None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:26.013710 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311785d-9aad-480b-8623-f6df8dec16f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:26.014337 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311785d-9aad-480b-8623-f6df8dec16f8 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:26.014649 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311785d-9aad-480b-8623-f6df8dec16f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:26.014922 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311785d-9aad-480b-8623-f6df8dec16f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:26.025410 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311785d-9aad-480b-8623-f6df8dec16f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:26.026873 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311785d-9aad-480b-8623-f6df8dec16f8 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:26.041025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-7311785d-9aad-480b-8623-f6df8dec16f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:26.041025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:26.041025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:26.041025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:26.041025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:26.041025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:26.041025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:26.041025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:26.041025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:26.041025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:26.041025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:26.041025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:26.041025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:15:26.041025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:15:26.041025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:15:26.041025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:15:26.042076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:26.042076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:26.042076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:26.042076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:26.042076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:26.042076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:26.042076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:26.042076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:26.042076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:26.042076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:26.042076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:26.042076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:26.042076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:26.042076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:26.042076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:26.042076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:26.042076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:15:26.043009 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:15:26.043009 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:26.043009 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:15:26.043009 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 435/890] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:26.047929 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d8e55-abaf-473d-a30e-33c7f4d7e92a None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:26.150628 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d8e55-abaf-473d-a30e-33c7f4d7e92a None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:26.184347 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4af837-9757-42bd-9112-bed9320ec2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:26.184948 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4af837-9757-42bd-9112-bed9320ec2f8 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:26.185224 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4af837-9757-42bd-9112-bed9320ec2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:26.185491 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4af837-9757-42bd-9112-bed9320ec2f8 None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:26.186125 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4af837-9757-42bd-9112-bed9320ec2f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:26.186425 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4af837-9757-42bd-9112-bed9320ec2f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:26.187866 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4af837-9757-42bd-9112-bed9320ec2f8 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:26.199823 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 456/891] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:26.205527 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311785d-9aad-480b-8623-f6df8dec16f8 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:26.238071 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:26.303726 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311785d-9aad-480b-8623-f6df8dec16f8 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:26.336369 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e09af0-7d2f-4d08-94ce-416670f49185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:26.336986 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e09af0-7d2f-4d08-94ce-416670f49185 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:26.337265 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e09af0-7d2f-4d08-94ce-416670f49185 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:26.337538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e09af0-7d2f-4d08-94ce-416670f49185 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:26.344010 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e09af0-7d2f-4d08-94ce-416670f49185 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:26.345448 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e09af0-7d2f-4d08-94ce-416670f49185 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:26.356877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-e6e09af0-7d2f-4d08-94ce-416670f49185 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:15:26.356877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:26.356877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:26.356877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:26.356877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:26.356877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:26.356877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:26.356877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:26.356877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:26.356877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:26.356877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:26.356877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:26.356877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:15:26.356877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:15:26.356877 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:15:26.357909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:15:26.357909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:26.357909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:26.357909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:26.357909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:26.357909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:26.357909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:26.357909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:26.357909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:26.357909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:26.357909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:26.357909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:26.357909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:26.357909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:26.357909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:26.357909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:26.357909 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:26.358880 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:15:26.358880 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:15:26.358880 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:15:26.358880 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:15:26.358880 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:15:26.358880 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:15:26.358880 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:15:26.358880 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:15:26.358880 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 436/892] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:15:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:26.364554 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4af837-9757-42bd-9112-bed9320ec2f8 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:26.422405 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:26.467607 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4af837-9757-42bd-9112-bed9320ec2f8 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:26.501810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b332af2-3a5a-4ae0-8753-95739490c49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:26.502441 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b332af2-3a5a-4ae0-8753-95739490c49b None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:26.502744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b332af2-3a5a-4ae0-8753-95739490c49b None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:26.503016 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b332af2-3a5a-4ae0-8753-95739490c49b None admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:26.503697 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b332af2-3a5a-4ae0-8753-95739490c49b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:26.503998 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b332af2-3a5a-4ae0-8753-95739490c49b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:26.505477 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b332af2-3a5a-4ae0-8753-95739490c49b None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:26.517297 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 457/893] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:15:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:26.523525 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e09af0-7d2f-4d08-94ce-416670f49185 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:26.616807 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:26.625172 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e09af0-7d2f-4d08-94ce-416670f49185 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:26.657500 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27a4c7-7f44-4c3f-a699-6f2f29ca4308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:26.658146 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27a4c7-7f44-4c3f-a699-6f2f29ca4308 None admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:26.659128 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27a4c7-7f44-4c3f-a699-6f2f29ca4308 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:26.659404 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27a4c7-7f44-4c3f-a699-6f2f29ca4308 None admin] PATH_INFO: `/v3/projects/409a043500554125a93c4636db5a6812/users/4aab18dc39cf4d119ba5f07fda334ec1/roles/8fdfbc4aaf68468f89a5ae3450b8488d` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:26.661448 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27a4c7-7f44-4c3f-a699-6f2f29ca4308 None admin] RBAC: Authorizing `identity:create_grant(project_id=409a043500554125a93c4636db5a6812, user_id=4aab18dc39cf4d119ba5f07fda334ec1, role_id=8fdfbc4aaf68468f89a5ae3450b8488d)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:26.662905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27a4c7-7f44-4c3f-a699-6f2f29ca4308 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:26.738803 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 437/894] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Aug 19 19:15:26 2022] PUT /identity/v3/projects/409a043500554125a93c4636db5a6812/users/4aab18dc39cf4d119ba5f07fda334ec1/roles/8fdfbc4aaf68468f89a5ae3450b8488d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:15:28.918612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5543e-56d8-4cfd-8dee-aa62dd3b31d5 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:28.919154 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5543e-56d8-4cfd-8dee-aa62dd3b31d5 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:28.919154 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5543e-56d8-4cfd-8dee-aa62dd3b31d5 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:28.920404 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 458/895] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:15:28.926344 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c766781-e7a8-47d9-a452-2bdbee2de2df None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:28.926818 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c766781-e7a8-47d9-a452-2bdbee2de2df None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:28.926927 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c766781-e7a8-47d9-a452-2bdbee2de2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:28.946263 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-9c766781-e7a8-47d9-a452-2bdbee2de2df None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:15:28.947534 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9c766781-e7a8-47d9-a452-2bdbee2de2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:15:29.014340 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 438/896] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:15:28 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:15:29.355938 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5543e-56d8-4cfd-8dee-aa62dd3b31d5 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:29.460900 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5543e-56d8-4cfd-8dee-aa62dd3b31d5 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:29.475030 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:29.496559 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16de80-df73-4ec4-aafd-c0c7e05bf801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:29.499793 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16de80-df73-4ec4-aafd-c0c7e05bf801 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:29.499793 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16de80-df73-4ec4-aafd-c0c7e05bf801 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:29.499793 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16de80-df73-4ec4-aafd-c0c7e05bf801 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:29.508134 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16de80-df73-4ec4-aafd-c0c7e05bf801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 19:15:29.513141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-6e16de80-df73-4ec4-aafd-c0c7e05bf801 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:15:29.513141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:29.513141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:29.513141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:29.513141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:29.513141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:29.513141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:29.513141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:29.513141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:29.513141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:29.513141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:29.513141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:29.513141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 19:15:29.513141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 19:15:29.513141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 19:15:29.513141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 19:15:29.514346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 19:15:29.514346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 19:15:29.514346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 19:15:29.514346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 19:15:29.514346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:29.514346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:29.514346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:29.514346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:29.514346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:29.514346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:29.514346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:29.514346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:29.514346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:29.514346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:29.514346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:29.514346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:29.515668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:29.515668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:29.515668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:29.515668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:29.515668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 19:15:29.515668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 19:15:29.515668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 19:15:29.515668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 19:15:29.515668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 19:15:29.515668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 19:15:29.515668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 19:15:29.515668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:29.515668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 459/897] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Aug 19 19:15:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:29.521473 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c766781-e7a8-47d9-a452-2bdbee2de2df None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:29.605171 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:29.622707 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c766781-e7a8-47d9-a452-2bdbee2de2df None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:29.656088 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de2ddb-076d-40eb-ae69-6b5f89f218cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:29.656734 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de2ddb-076d-40eb-ae69-6b5f89f218cf None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:29.657050 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de2ddb-076d-40eb-ae69-6b5f89f218cf None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:29.657313 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de2ddb-076d-40eb-ae69-6b5f89f218cf None admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:29.657960 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de2ddb-076d-40eb-ae69-6b5f89f218cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:29.658311 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de2ddb-076d-40eb-ae69-6b5f89f218cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:29.659692 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de2ddb-076d-40eb-ae69-6b5f89f218cf None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:29.667538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 439/898] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Aug 19 19:15:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:29.674325 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16de80-df73-4ec4-aafd-c0c7e05bf801 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:29.775235 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16de80-df73-4ec4-aafd-c0c7e05bf801 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:29.808825 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993f5f5-56b9-4d53-9b37-06368f7c0976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:29.809445 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993f5f5-56b9-4d53-9b37-06368f7c0976 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:29.809738 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993f5f5-56b9-4d53-9b37-06368f7c0976 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:29.809989 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993f5f5-56b9-4d53-9b37-06368f7c0976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:29.821408 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993f5f5-56b9-4d53-9b37-06368f7c0976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:29.825585 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993f5f5-56b9-4d53-9b37-06368f7c0976 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:29.837177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-4993f5f5-56b9-4d53-9b37-06368f7c0976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:29.837177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:29.837177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:29.837177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:29.837177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:29.837177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:29.837177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:29.837177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:29.837177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:29.837177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:29.837177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:29.837177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:29.837177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:15:29.837177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:15:29.837177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:15:29.837177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:15:29.838328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:29.838328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:29.838328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:29.838328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:29.838328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:29.838328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:29.838328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:29.838328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:29.838328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:29.838328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:29.838328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:29.838328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:29.838328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:29.838328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:29.838328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:29.838328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:29.838328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:15:29.839599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:15:29.839599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:29.839599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:29.839599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 460/899] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:29.844122 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de2ddb-076d-40eb-ae69-6b5f89f218cf None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:29.945787 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de2ddb-076d-40eb-ae69-6b5f89f218cf None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:29.978952 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb241db3-5278-4c6a-ab90-652d2a23e2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:29.979552 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb241db3-5278-4c6a-ab90-652d2a23e2bd None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:29.979830 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb241db3-5278-4c6a-ab90-652d2a23e2bd None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:29.980099 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb241db3-5278-4c6a-ab90-652d2a23e2bd None admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:29.980732 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb241db3-5278-4c6a-ab90-652d2a23e2bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:29.981032 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb241db3-5278-4c6a-ab90-652d2a23e2bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:29.982392 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb241db3-5278-4c6a-ab90-652d2a23e2bd None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:29.995003 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 440/900] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:30.000722 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993f5f5-56b9-4d53-9b37-06368f7c0976 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:30.028916 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:30.100817 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993f5f5-56b9-4d53-9b37-06368f7c0976 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:30.136618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb08f2-4d4f-4577-82a4-440a68745d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:30.137247 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb08f2-4d4f-4577-82a4-440a68745d55 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:30.137526 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb08f2-4d4f-4577-82a4-440a68745d55 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:30.137797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb08f2-4d4f-4577-82a4-440a68745d55 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:30.145106 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb08f2-4d4f-4577-82a4-440a68745d55 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:30.146552 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb08f2-4d4f-4577-82a4-440a68745d55 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:30.157675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-54bb08f2-4d4f-4577-82a4-440a68745d55 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:15:30.157675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:30.157675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:30.157675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:30.157675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:30.157675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:30.157675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:30.157675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:30.157675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:30.157675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:30.157675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:30.157675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:30.157675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 19:15:30.157675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 19:15:30.157675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 19:15:30.157675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 19:15:30.159431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:30.159431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:30.159431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 19:15:30.159431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:15:30.159431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 19:15:30.159431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 19:15:30.159431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:30.159431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:30.159431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:30.159431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:30.159431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:30.159431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:30.159431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:30.159431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:30.159431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:30.159431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:30.159431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:30.159431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:30.160829 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:30.160829 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:30.160829 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 19:15:30.160829 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 19:15:30.160829 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 19:15:30.160829 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 19:15:30.160829 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 19:15:30.160829 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 19:15:30.160829 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 19:15:30.160829 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:30.160829 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 461/901] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:30.165254 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb241db3-5278-4c6a-ab90-652d2a23e2bd None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:30.169136 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:30.262887 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb241db3-5278-4c6a-ab90-652d2a23e2bd None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:30.296360 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94f0f1-109b-4527-aa4c-f49cf8ae4cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:30.296958 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94f0f1-109b-4527-aa4c-f49cf8ae4cfc None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:30.297387 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94f0f1-109b-4527-aa4c-f49cf8ae4cfc None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:30.297585 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94f0f1-109b-4527-aa4c-f49cf8ae4cfc None admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:30.298292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94f0f1-109b-4527-aa4c-f49cf8ae4cfc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:30.298634 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94f0f1-109b-4527-aa4c-f49cf8ae4cfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:30.302187 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94f0f1-109b-4527-aa4c-f49cf8ae4cfc None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:30.317472 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 441/902] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Aug 19 19:15:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:30.323307 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb08f2-4d4f-4577-82a4-440a68745d55 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:30.406817 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:30.421704 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb08f2-4d4f-4577-82a4-440a68745d55 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:30.454776 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745ac87-f68e-45da-834f-535ec65a3bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:30.456087 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745ac87-f68e-45da-834f-535ec65a3bad None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:30.456368 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745ac87-f68e-45da-834f-535ec65a3bad None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:30.456640 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745ac87-f68e-45da-834f-535ec65a3bad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:30.521934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745ac87-f68e-45da-834f-535ec65a3bad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:30.523359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745ac87-f68e-45da-834f-535ec65a3bad None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:30.605780 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:30.620465 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 462/903] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Aug 19 19:15:30 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 19:15:30.626237 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94f0f1-109b-4527-aa4c-f49cf8ae4cfc None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:30.688225 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:30.726529 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94f0f1-109b-4527-aa4c-f49cf8ae4cfc None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:30.760350 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de7991-8b96-4079-b7e7-9422ef9778ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:30.760971 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de7991-8b96-4079-b7e7-9422ef9778ce None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:30.761246 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de7991-8b96-4079-b7e7-9422ef9778ce None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:30.761511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de7991-8b96-4079-b7e7-9422ef9778ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:30.771299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de7991-8b96-4079-b7e7-9422ef9778ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:30.773155 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de7991-8b96-4079-b7e7-9422ef9778ce None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:30.787629 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-38de7991-8b96-4079-b7e7-9422ef9778ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:30.787629 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:30.787629 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:30.787629 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:30.787629 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:30.787629 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:30.787629 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:30.787629 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:30.787629 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:30.787629 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:30.787629 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:30.787629 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:30.787629 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 19:15:30.787629 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 19:15:30.787629 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 19:15:30.787629 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 19:15:30.788645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:30.788645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:30.788645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:30.788645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:30.788645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:30.788645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:30.788645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:30.788645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:30.788645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:30.788645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:30.788645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:30.788645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:30.788645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:30.788645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:30.788645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:30.788645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:30.788645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 19:15:30.789580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 19:15:30.789580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 19:15:30.789580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:15:30.789580 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 442/904] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:30.794581 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745ac87-f68e-45da-834f-535ec65a3bad None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:30.895562 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745ac87-f68e-45da-834f-535ec65a3bad None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:30.930975 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df18321-86a8-48c7-9c01-dae4428d9df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:30.931579 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df18321-86a8-48c7-9c01-dae4428d9df9 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:30.931858 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df18321-86a8-48c7-9c01-dae4428d9df9 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:30.932128 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df18321-86a8-48c7-9c01-dae4428d9df9 None admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:30.932766 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df18321-86a8-48c7-9c01-dae4428d9df9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:30.933071 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df18321-86a8-48c7-9c01-dae4428d9df9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:30.934434 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df18321-86a8-48c7-9c01-dae4428d9df9 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:30.946461 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 463/905] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Aug 19 19:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:30.952089 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de7991-8b96-4079-b7e7-9422ef9778ce None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:31.051742 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de7991-8b96-4079-b7e7-9422ef9778ce None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:31.065211 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:31.084733 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd3886-a2f9-4f10-a708-339fb091731f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:31.085457 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd3886-a2f9-4f10-a708-339fb091731f None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:31.085736 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd3886-a2f9-4f10-a708-339fb091731f None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:31.086009 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd3886-a2f9-4f10-a708-339fb091731f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:31.092445 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd3886-a2f9-4f10-a708-339fb091731f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:31.093882 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd3886-a2f9-4f10-a708-339fb091731f None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:31.105524 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application [None req-3ccd3886-a2f9-4f10-a708-339fb091731f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:15:31.105524 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:31.105524 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:31.105524 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:31.105524 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:31.105524 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:31.105524 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:31.105524 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:31.105524 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:31.105524 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:31.105524 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:31.105524 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:31.105524 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 19:15:31.105524 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 19:15:31.105524 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 19:15:31.106633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 19:15:31.106633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:31.106633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:31.106633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:31.106633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:31.106633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:31.106633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:31.106633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:31.106633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:31.106633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:31.106633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:31.106633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:31.106633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:31.106633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:31.106633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:31.106633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:31.106633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:31.115108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 19:15:31.115108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 19:15:31.115108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 19:15:31.115108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 19:15:31.115108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 19:15:31.115108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 19:15:31.115108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 19:15:31.115108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: ERROR keystone.server.flask.application Aug 19 19:15:31.115108 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 443/906] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Aug 19 19:15:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:31.115728 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df18321-86a8-48c7-9c01-dae4428d9df9 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:31.160718 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:31.214947 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df18321-86a8-48c7-9c01-dae4428d9df9 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:31.247957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b84cd-1744-4891-bb72-ea6479613492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:31.248552 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b84cd-1744-4891-bb72-ea6479613492 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:31.248833 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b84cd-1744-4891-bb72-ea6479613492 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:31.249102 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b84cd-1744-4891-bb72-ea6479613492 None admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:31.249782 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b84cd-1744-4891-bb72-ea6479613492 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:31.250081 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b84cd-1744-4891-bb72-ea6479613492 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:31.251509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b84cd-1744-4891-bb72-ea6479613492 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:31.264126 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 464/907] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Aug 19 19:15:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:31.270928 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd3886-a2f9-4f10-a708-339fb091731f None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:31.369456 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd3886-a2f9-4f10-a708-339fb091731f None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:31.401966 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5605e9-44ca-46e3-8603-e6d0c888192a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:31.402581 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5605e9-44ca-46e3-8603-e6d0c888192a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:31.402856 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5605e9-44ca-46e3-8603-e6d0c888192a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:31.403123 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5605e9-44ca-46e3-8603-e6d0c888192a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:31.403822 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5605e9-44ca-46e3-8603-e6d0c888192a None admin] RBAC: Adding query filter params (role.id=8fdfbc4aaf68468f89a5ae3450b8488d, scope.project.id=409a043500554125a93c4636db5a6812, user.id=4aab18dc39cf4d119ba5f07fda334ec1) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:31.404123 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5605e9-44ca-46e3-8603-e6d0c888192a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:31.405523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5605e9-44ca-46e3-8603-e6d0c888192a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:31.411812 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 444/908] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Aug 19 19:15:31 2022] GET /identity/v3/role_assignments?user.id=4aab18dc39cf4d119ba5f07fda334ec1&scope.project.id=409a043500554125a93c4636db5a6812&role.id=8fdfbc4aaf68468f89a5ae3450b8488d => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:33.668009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce363c-d0e0-42d0-9ead-f0fa82ec4b8f None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:33.668529 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce363c-d0e0-42d0-9ead-f0fa82ec4b8f None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:33.668655 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce363c-d0e0-42d0-9ead-f0fa82ec4b8f None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:33.669908 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 465/909] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:15:33.675644 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e80d0-fca8-4c5c-960f-eea7f7be452b None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:33.676029 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e80d0-fca8-4c5c-960f-eea7f7be452b None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:33.676185 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e80d0-fca8-4c5c-960f-eea7f7be452b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:33.694702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-536e80d0-fca8-4c5c-960f-eea7f7be452b None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:15:33.695881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-536e80d0-fca8-4c5c-960f-eea7f7be452b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:15:33.728970 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:33.772294 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 445/910] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:15:33 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:15:34.113711 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce363c-d0e0-42d0-9ead-f0fa82ec4b8f None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:34.215188 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce363c-d0e0-42d0-9ead-f0fa82ec4b8f None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:34.223011 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:34.249078 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9286cf-15cc-4ca6-ac18-6b1466a3cce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:34.254445 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9286cf-15cc-4ca6-ac18-6b1466a3cce8 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:34.254445 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9286cf-15cc-4ca6-ac18-6b1466a3cce8 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:34.254445 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9286cf-15cc-4ca6-ac18-6b1466a3cce8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:34.254445 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9286cf-15cc-4ca6-ac18-6b1466a3cce8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:34.254445 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9286cf-15cc-4ca6-ac18-6b1466a3cce8 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:34.260774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-ac9286cf-15cc-4ca6-ac18-6b1466a3cce8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 19:15:34.260774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:34.260774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:15:34.260774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:15:34.260774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:15:34.260774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:15:34.260774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:15:34.260774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:15:34.260774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 19:15:34.260774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:34.260774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:15:34.260774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:34.260774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:34.260774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:34.260774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:34.260774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:34.260774 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:34.261950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:34.261950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:34.261950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:34.261950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:34.261950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:34.261950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:34.261950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:15:34.261950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:15:34.261950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:15:34.261950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:15:34.261950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:34.261950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:34.261950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:34.261950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:34.261950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:34.261950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:34.262971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:34.262971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:34.262971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:34.262971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:34.262971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:34.262971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:34.262971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:34.262971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:34.262971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:34.262971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:34.262971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:15:34.262971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:15:34.262971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 19:15:34.262971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:34.262971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 466/911] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Aug 19 19:15:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:34.268226 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e80d0-fca8-4c5c-960f-eea7f7be452b None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:34.368225 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e80d0-fca8-4c5c-960f-eea7f7be452b None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:34.400858 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fb8dc-ec84-48db-a101-89b96b0fe23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:34.401459 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fb8dc-ec84-48db-a101-89b96b0fe23a None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:34.401737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fb8dc-ec84-48db-a101-89b96b0fe23a None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:34.402009 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fb8dc-ec84-48db-a101-89b96b0fe23a None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:34.402679 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fb8dc-ec84-48db-a101-89b96b0fe23a None admin] RBAC: Adding query filter params (name=placement) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:34.402984 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fb8dc-ec84-48db-a101-89b96b0fe23a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:34.404348 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fb8dc-ec84-48db-a101-89b96b0fe23a None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:34.409535 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 446/912] 10.222.0.61 () {56 vars in 1116 bytes} [Fri Aug 19 19:15:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:34.415910 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9286cf-15cc-4ca6-ac18-6b1466a3cce8 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:34.514628 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9286cf-15cc-4ca6-ac18-6b1466a3cce8 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:34.547898 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3784f-66f9-4f80-8c0c-e0928d0b44f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:34.549091 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3784f-66f9-4f80-8c0c-e0928d0b44f4 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:34.549539 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3784f-66f9-4f80-8c0c-e0928d0b44f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:34.549815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3784f-66f9-4f80-8c0c-e0928d0b44f4 None admin] PATH_INFO: `/v3/services` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:34.550546 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3784f-66f9-4f80-8c0c-e0928d0b44f4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:34.550999 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3784f-66f9-4f80-8c0c-e0928d0b44f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:34.552424 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3784f-66f9-4f80-8c0c-e0928d0b44f4 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:34.557017 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 467/913] 10.222.0.61 () {56 vars in 1116 bytes} [Fri Aug 19 19:15:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:36.758620 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b44df6-260a-4f04-828e-e0e70c90d8d0 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:36.759180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b44df6-260a-4f04-828e-e0e70c90d8d0 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:36.759180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b44df6-260a-4f04-828e-e0e70c90d8d0 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:36.760496 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 447/914] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:15:36.765830 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfdb0b-e761-4235-980a-760731de68d4 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:36.766234 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfdb0b-e761-4235-980a-760731de68d4 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:36.769555 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfdb0b-e761-4235-980a-760731de68d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:36.785577 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-3bbfdb0b-e761-4235-980a-760731de68d4 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:15:36.786803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-3bbfdb0b-e761-4235-980a-760731de68d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:15:36.815141 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:36.854957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 468/915] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:15:36 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:15:37.182235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b44df6-260a-4f04-828e-e0e70c90d8d0 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:37.213952 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:37.284982 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b44df6-260a-4f04-828e-e0e70c90d8d0 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:37.318232 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f72df0-c4e9-485c-a5b6-4008f6e95d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:37.318856 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f72df0-c4e9-485c-a5b6-4008f6e95d9b None admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:37.319129 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f72df0-c4e9-485c-a5b6-4008f6e95d9b None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:37.319398 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f72df0-c4e9-485c-a5b6-4008f6e95d9b None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:37.320033 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f72df0-c4e9-485c-a5b6-4008f6e95d9b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:37.321383 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f72df0-c4e9-485c-a5b6-4008f6e95d9b None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:37.411014 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 448/916] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Aug 19 19:15:37 2022] POST /identity/v3/services => generated 246 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:15:39.647398 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4da0fe-cbf2-4d36-992a-7c1e9a948683 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:39.647900 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4da0fe-cbf2-4d36-992a-7c1e9a948683 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:39.648124 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4da0fe-cbf2-4d36-992a-7c1e9a948683 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:39.649442 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 469/917] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:15:39.654646 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad0879-a955-4e4b-8b5e-16ce821b18dd None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:39.655024 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad0879-a955-4e4b-8b5e-16ce821b18dd None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:39.655193 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad0879-a955-4e4b-8b5e-16ce821b18dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:39.672952 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-36ad0879-a955-4e4b-8b5e-16ce821b18dd None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:15:39.674159 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-36ad0879-a955-4e4b-8b5e-16ce821b18dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:15:39.745053 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 449/918] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:15:39 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:15:40.077211 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4da0fe-cbf2-4d36-992a-7c1e9a948683 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:40.177453 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4da0fe-cbf2-4d36-992a-7c1e9a948683 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:40.211541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b5f96-47d9-48ef-9f8e-0224b1bb42c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:40.212222 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b5f96-47d9-48ef-9f8e-0224b1bb42c9 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:40.212507 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b5f96-47d9-48ef-9f8e-0224b1bb42c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:40.212779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b5f96-47d9-48ef-9f8e-0224b1bb42c9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:40.213355 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b5f96-47d9-48ef-9f8e-0224b1bb42c9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:40.214741 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b5f96-47d9-48ef-9f8e-0224b1bb42c9 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:40.224256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-5b9b5f96-47d9-48ef-9f8e-0224b1bb42c9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 19:15:40.224256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:40.224256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:15:40.224256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:15:40.224256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:15:40.224256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:15:40.224256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:15:40.224256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:15:40.224256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 19:15:40.224256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:40.224256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:15:40.224256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:40.224256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:40.224256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:40.224256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:40.224256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:40.224256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:40.225422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:40.225422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:40.225422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:40.225422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:40.225422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:40.225422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:40.225422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:15:40.225422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:15:40.225422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:15:40.225422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:15:40.225422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:40.225422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:40.225422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:40.225422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:40.225422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:40.225422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:40.226457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:40.226457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:40.226457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:40.226457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:40.226457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:40.226457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:40.226457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:40.226457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:40.226457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:40.226457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:40.226457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:15:40.226457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:15:40.226457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 19:15:40.226457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:40.226457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 470/919] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Aug 19 19:15:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:40.231422 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad0879-a955-4e4b-8b5e-16ce821b18dd None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:40.250277 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:40.331484 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad0879-a955-4e4b-8b5e-16ce821b18dd None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:40.363763 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e751aa-19cd-433d-9722-64168e2053c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:40.364309 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e751aa-19cd-433d-9722-64168e2053c7 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:40.364587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e751aa-19cd-433d-9722-64168e2053c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:40.364857 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e751aa-19cd-433d-9722-64168e2053c7 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:40.365472 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e751aa-19cd-433d-9722-64168e2053c7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:40.365773 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e751aa-19cd-433d-9722-64168e2053c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:40.367159 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e751aa-19cd-433d-9722-64168e2053c7 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:40.372065 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 450/920] 10.222.0.61 () {56 vars in 1116 bytes} [Fri Aug 19 19:15:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:40.378613 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b5f96-47d9-48ef-9f8e-0224b1bb42c9 None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:40.409620 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:40.479922 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b5f96-47d9-48ef-9f8e-0224b1bb42c9 None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:40.513046 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed41551-a5fa-4d6c-bc33-babf3a854d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:40.513645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed41551-a5fa-4d6c-bc33-babf3a854d27 None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:40.513926 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed41551-a5fa-4d6c-bc33-babf3a854d27 None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:40.514198 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed41551-a5fa-4d6c-bc33-babf3a854d27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:40.514926 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed41551-a5fa-4d6c-bc33-babf3a854d27 None admin] RBAC: Adding query filter params (interface=public, service_id=67757abc7a9d48e095fbef6bf320ef13, region_id=RegionOne) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:40.515232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed41551-a5fa-4d6c-bc33-babf3a854d27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:40.516592 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed41551-a5fa-4d6c-bc33-babf3a854d27 None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:40.521463 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 471/921] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Aug 19 19:15:40 2022] GET /identity/v3/endpoints?service_id=67757abc7a9d48e095fbef6bf320ef13&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:40.527631 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e751aa-19cd-433d-9722-64168e2053c7 None admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:40.611131 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:40.628548 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e751aa-19cd-433d-9722-64168e2053c7 None admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:40.662758 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df898723-8967-4e17-a3e1-7fde01ee36d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:40.663841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df898723-8967-4e17-a3e1-7fde01ee36d9 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:40.663841 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df898723-8967-4e17-a3e1-7fde01ee36d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:40.664012 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df898723-8967-4e17-a3e1-7fde01ee36d9 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:40.664462 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df898723-8967-4e17-a3e1-7fde01ee36d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:40.665828 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df898723-8967-4e17-a3e1-7fde01ee36d9 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:40.672260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 451/922] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Aug 19 19:15:40 2022] GET /identity/v3/services => generated 1962 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 19:15:42.849531 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2364d-56c7-46f8-a254-e1473a46a01c None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:42.850047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2364d-56c7-46f8-a254-e1473a46a01c None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:42.850047 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2364d-56c7-46f8-a254-e1473a46a01c None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:42.851347 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 472/923] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:15:42.856484 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691ed9f-14ab-4275-9342-6a358f2b2d84 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:42.864505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691ed9f-14ab-4275-9342-6a358f2b2d84 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:42.864505 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691ed9f-14ab-4275-9342-6a358f2b2d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:42.875517 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-7691ed9f-14ab-4275-9342-6a358f2b2d84 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:15:42.877094 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7691ed9f-14ab-4275-9342-6a358f2b2d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:15:42.942770 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 452/924] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:15:42 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 19:15:43.277791 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2364d-56c7-46f8-a254-e1473a46a01c None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:43.372239 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:43.382189 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2364d-56c7-46f8-a254-e1473a46a01c None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:43.415447 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036df1d-75ad-45e0-9cbd-bd4c1a666cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:43.416072 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036df1d-75ad-45e0-9cbd-bd4c1a666cbc None admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:43.416351 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036df1d-75ad-45e0-9cbd-bd4c1a666cbc None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:43.416627 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036df1d-75ad-45e0-9cbd-bd4c1a666cbc None admin] PATH_INFO: `/v3/services/placement` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:43.417217 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036df1d-75ad-45e0-9cbd-bd4c1a666cbc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:43.418591 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036df1d-75ad-45e0-9cbd-bd4c1a666cbc None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:43.427649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application [None req-d036df1d-75ad-45e0-9cbd-bd4c1a666cbc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 19:15:43.427649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:43.427649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 19:15:43.427649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 19:15:43.427649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 19:15:43.427649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 19:15:43.427649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 19:15:43.427649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:15:43.427649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 19:15:43.427649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:43.427649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 19:15:43.427649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:43.427649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 19:15:43.427649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 19:15:43.427649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 19:15:43.427649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 19:15:43.427649 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 19:15:43.428802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 19:15:43.428802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 19:15:43.428802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 19:15:43.428802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 19:15:43.428802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 19:15:43.428802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 19:15:43.428802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 19:15:43.428802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 19:15:43.428802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 19:15:43.428802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 19:15:43.428802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 19:15:43.428802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 19:15:43.428802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 19:15:43.428802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 19:15:43.428802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 19:15:43.428802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 19:15:43.429820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 19:15:43.429820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application with Lock( Aug 19 19:15:43.429820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 19:15:43.429820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self._enter() Aug 19 19:15:43.429820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 19:15:43.429820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 19:15:43.429820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 19:15:43.429820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application return self.creator() Aug 19 19:15:43.429820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 19:15:43.429820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application created_value = creator( Aug 19 19:15:43.429820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 19:15:43.429820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 19:15:43.429820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 19:15:43.429820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: ERROR keystone.server.flask.application Aug 19 19:15:43.429820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 473/925] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Aug 19 19:15:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 19:15:43.434888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691ed9f-14ab-4275-9342-6a358f2b2d84 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:43.510691 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:43.532685 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691ed9f-14ab-4275-9342-6a358f2b2d84 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:43.569050 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816575a-9b4b-4faf-baf0-dea212fce473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:43.569663 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816575a-9b4b-4faf-baf0-dea212fce473 None admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:43.569944 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816575a-9b4b-4faf-baf0-dea212fce473 None admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:43.570222 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816575a-9b4b-4faf-baf0-dea212fce473 None admin] PATH_INFO: `/v3/services` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:43.570887 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816575a-9b4b-4faf-baf0-dea212fce473 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:15:43.571192 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816575a-9b4b-4faf-baf0-dea212fce473 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:43.572561 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816575a-9b4b-4faf-baf0-dea212fce473 None admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:43.577766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 453/926] 10.222.0.61 () {56 vars in 1116 bytes} [Fri Aug 19 19:15:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:15:43.583896 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036df1d-75ad-45e0-9cbd-bd4c1a666cbc None admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:15:43.683153 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036df1d-75ad-45e0-9cbd-bd4c1a666cbc None admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:15:43.716052 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cc2d6-937e-4453-9050-81ebfd9924bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:15:43.716636 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cc2d6-937e-4453-9050-81ebfd9924bc None admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:15:43.716914 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cc2d6-937e-4453-9050-81ebfd9924bc None admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:15:43.717186 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cc2d6-937e-4453-9050-81ebfd9924bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:15:43.717835 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cc2d6-937e-4453-9050-81ebfd9924bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:15:43.719268 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cc2d6-937e-4453-9050-81ebfd9924bc None admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:15:43.852606 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 474/927] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Aug 19 19:15:43 2022] POST /identity/v3/endpoints => generated 331 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:15:53.574964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=30 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:15:53.848188 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:01.684069 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a9f10-94a1-4d8a-b219-35d2724011d4 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:01.684646 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a9f10-94a1-4d8a-b219-35d2724011d4 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:01.684646 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a9f10-94a1-4d8a-b219-35d2724011d4 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:01.686758 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 454/928] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:01.692092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa4e1b-28c6-455d-8360-8df16871e5b8 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:01.692519 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa4e1b-28c6-455d-8360-8df16871e5b8 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:01.692744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa4e1b-28c6-455d-8360-8df16871e5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:01.794275 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-0efa4e1b-28c6-455d-8360-8df16871e5b8 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:01.796351 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-0efa4e1b-28c6-455d-8360-8df16871e5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:01.962990 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 475/929] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:22:02.321188 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69739c-dccf-48bb-863b-aa063f6bb75a None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:02.321607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69739c-dccf-48bb-863b-aa063f6bb75a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:02.321948 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69739c-dccf-48bb-863b-aa063f6bb75a None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:02.323404 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 455/930] 10.222.0.61 () {54 vars in 965 bytes} [Fri Aug 19 19:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:02.330306 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275827b8-775a-47ea-89ba-e562070701e2 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:02.330707 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275827b8-775a-47ea-89ba-e562070701e2 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:02.331050 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275827b8-775a-47ea-89ba-e562070701e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:02.389261 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-275827b8-775a-47ea-89ba-e562070701e2 None None] MFA Rules not processed for user `84bd0bde9a164516a26768a3eb44fdec`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:02.390542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-275827b8-775a-47ea-89ba-e562070701e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:02.431709 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:02.465253 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 476/931] 10.222.0.61 () {58 vars in 1062 bytes} [Fri Aug 19 19:22:02 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:22:02.474081 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69739c-dccf-48bb-863b-aa063f6bb75a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:02.486186 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69739c-dccf-48bb-863b-aa063f6bb75a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:02.489681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455a965-45c5-400e-bd62-e5ba2728abdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:02.490339 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455a965-45c5-400e-bd62-e5ba2728abdd service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:02.490717 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455a965-45c5-400e-bd62-e5ba2728abdd service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:02.491072 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455a965-45c5-400e-bd62-e5ba2728abdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:02.500811 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455a965-45c5-400e-bd62-e5ba2728abdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:02.502652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455a965-45c5-400e-bd62-e5ba2728abdd service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:02.512128 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 456/932] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:22:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:22:05.023169 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fc1d6-b68a-4ecb-ba4f-8c0bb63384b9 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:05.023689 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fc1d6-b68a-4ecb-ba4f-8c0bb63384b9 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:05.023689 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fc1d6-b68a-4ecb-ba4f-8c0bb63384b9 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:05.025090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 477/933] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:05.031030 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15125079-3ec0-48e8-86e6-995cacbad94e None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:05.031478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15125079-3ec0-48e8-86e6-995cacbad94e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:05.031582 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15125079-3ec0-48e8-86e6-995cacbad94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:05.053057 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-15125079-3ec0-48e8-86e6-995cacbad94e None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:05.054276 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-15125079-3ec0-48e8-86e6-995cacbad94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:05.063296 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 457/934] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:22:05.419725 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fc1d6-b68a-4ecb-ba4f-8c0bb63384b9 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:05.430443 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fc1d6-b68a-4ecb-ba4f-8c0bb63384b9 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:05.433866 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31f2fd-16b3-4a6e-aee1-0a852366810c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:05.434455 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31f2fd-16b3-4a6e-aee1-0a852366810c service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:05.434761 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31f2fd-16b3-4a6e-aee1-0a852366810c service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:05.435025 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31f2fd-16b3-4a6e-aee1-0a852366810c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:05.444408 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31f2fd-16b3-4a6e-aee1-0a852366810c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:05.445841 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31f2fd-16b3-4a6e-aee1-0a852366810c service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:05.456067 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 478/935] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:22:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:22:08.190758 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c0685-e0a1-4c59-b67d-e77b0e60cb04 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:08.191364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c0685-e0a1-4c59-b67d-e77b0e60cb04 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:08.191364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c0685-e0a1-4c59-b67d-e77b0e60cb04 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:08.192654 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 458/936] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:08.197894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0ce68-1fdb-4fe3-9b15-55956626ec94 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:08.198325 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0ce68-1fdb-4fe3-9b15-55956626ec94 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:08.198586 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0ce68-1fdb-4fe3-9b15-55956626ec94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:08.259199 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-aad0ce68-1fdb-4fe3-9b15-55956626ec94 None None] MFA Rules not processed for user `9d563cd2f3b848a3b1b5f14c04761740`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:08.260434 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-aad0ce68-1fdb-4fe3-9b15-55956626ec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:08.344777 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 479/937] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:08 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:22:08.692324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c0685-e0a1-4c59-b67d-e77b0e60cb04 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:08.704480 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c0685-e0a1-4c59-b67d-e77b0e60cb04 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:08.708190 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564fa2b-f70a-4d95-836c-161c2ee1245a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:08.708899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564fa2b-f70a-4d95-836c-161c2ee1245a service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:08.709247 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564fa2b-f70a-4d95-836c-161c2ee1245a service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:08.709586 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564fa2b-f70a-4d95-836c-161c2ee1245a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:08.720273 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564fa2b-f70a-4d95-836c-161c2ee1245a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:08.723722 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564fa2b-f70a-4d95-836c-161c2ee1245a service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:08.732601 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 459/938] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:22:08 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:22:11.785305 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08d644-c074-4c35-a89b-d3458e8c4474 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:11.785838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08d644-c074-4c35-a89b-d3458e8c4474 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:11.785838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08d644-c074-4c35-a89b-d3458e8c4474 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:11.787242 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 480/939] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:11.792554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70636402-966c-484d-ad9e-c7cdc143f023 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:11.792964 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70636402-966c-484d-ad9e-c7cdc143f023 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:11.793098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70636402-966c-484d-ad9e-c7cdc143f023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:11.812530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-70636402-966c-484d-ad9e-c7cdc143f023 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:11.813981 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-70636402-966c-484d-ad9e-c7cdc143f023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:11.882645 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 460/940] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:11 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:22:12.223712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08d644-c074-4c35-a89b-d3458e8c4474 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:12.234632 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08d644-c074-4c35-a89b-d3458e8c4474 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:12.238116 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45dc68-9733-4229-9ef2-4befa8240c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:12.238727 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45dc68-9733-4229-9ef2-4befa8240c10 service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:12.239005 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45dc68-9733-4229-9ef2-4befa8240c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:12.239275 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45dc68-9733-4229-9ef2-4befa8240c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:12.247767 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45dc68-9733-4229-9ef2-4befa8240c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:12.249240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45dc68-9733-4229-9ef2-4befa8240c10 service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:12.258275 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 481/941] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:22:12 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:22:15.409466 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149d06f-5b3e-46e1-9365-4c47e4cbfed2 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:15.410014 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149d06f-5b3e-46e1-9365-4c47e4cbfed2 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:15.410014 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149d06f-5b3e-46e1-9365-4c47e4cbfed2 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:15.411385 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 461/942] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:15.416660 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6b7d1-8a11-44d8-a560-651eb5dfba9d None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:15.417090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6b7d1-8a11-44d8-a560-651eb5dfba9d None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:15.417275 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6b7d1-8a11-44d8-a560-651eb5dfba9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:15.437329 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-e0b6b7d1-8a11-44d8-a560-651eb5dfba9d None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:15.438731 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-e0b6b7d1-8a11-44d8-a560-651eb5dfba9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:15.446468 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 482/943] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:22:15.789091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149d06f-5b3e-46e1-9365-4c47e4cbfed2 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:15.802836 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149d06f-5b3e-46e1-9365-4c47e4cbfed2 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:15.807263 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b5740-f516-4ac7-8790-679ef0e6c693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:15.807263 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b5740-f516-4ac7-8790-679ef0e6c693 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:15.807263 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b5740-f516-4ac7-8790-679ef0e6c693 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:15.807541 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b5740-f516-4ac7-8790-679ef0e6c693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:15.817146 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b5740-f516-4ac7-8790-679ef0e6c693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:15.818588 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b5740-f516-4ac7-8790-679ef0e6c693 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:15.828969 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 462/944] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:22:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:22:18.237153 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500200c-87aa-4ea4-98d3-1e699faaa7f2 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:18.237713 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500200c-87aa-4ea4-98d3-1e699faaa7f2 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:18.237809 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500200c-87aa-4ea4-98d3-1e699faaa7f2 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:18.239137 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 483/945] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:18.244354 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9d559-30ea-4dcc-868a-f29ec4379f8f None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:18.244795 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9d559-30ea-4dcc-868a-f29ec4379f8f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:18.244906 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9d559-30ea-4dcc-868a-f29ec4379f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:18.265520 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-d5d9d559-30ea-4dcc-868a-f29ec4379f8f None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:18.266746 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d5d9d559-30ea-4dcc-868a-f29ec4379f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:18.275438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 463/946] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:22:18.634590 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500200c-87aa-4ea4-98d3-1e699faaa7f2 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:18.645904 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500200c-87aa-4ea4-98d3-1e699faaa7f2 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:18.649299 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42747128-40a5-4d04-9b7c-ddd87a1ec2d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:18.649875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42747128-40a5-4d04-9b7c-ddd87a1ec2d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:18.650154 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42747128-40a5-4d04-9b7c-ddd87a1ec2d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:18.650417 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42747128-40a5-4d04-9b7c-ddd87a1ec2d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:18.660668 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42747128-40a5-4d04-9b7c-ddd87a1ec2d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:18.662096 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42747128-40a5-4d04-9b7c-ddd87a1ec2d4 service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:18.671596 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 484/947] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:22:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:22:20.942248 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dacb9-cc34-43fc-9a49-e9d8f8fe4e60 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:20.942813 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dacb9-cc34-43fc-9a49-e9d8f8fe4e60 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:20.942905 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dacb9-cc34-43fc-9a49-e9d8f8fe4e60 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:20.944202 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 464/948] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:20.949418 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731519cc-11c5-4d8d-a622-9e11332fff5c None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:20.949815 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731519cc-11c5-4d8d-a622-9e11332fff5c None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:20.949976 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731519cc-11c5-4d8d-a622-9e11332fff5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:20.970154 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-731519cc-11c5-4d8d-a622-9e11332fff5c None None] MFA Rules not processed for user `9d563cd2f3b848a3b1b5f14c04761740`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:20.971394 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-731519cc-11c5-4d8d-a622-9e11332fff5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:20.980463 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 485/949] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:20 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:22:21.332301 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dacb9-cc34-43fc-9a49-e9d8f8fe4e60 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:21.347437 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dacb9-cc34-43fc-9a49-e9d8f8fe4e60 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:21.350944 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7469be4-9ea2-4faf-9d5f-a4a85620a1dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:21.351559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7469be4-9ea2-4faf-9d5f-a4a85620a1dd service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:21.351833 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7469be4-9ea2-4faf-9d5f-a4a85620a1dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:21.352098 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7469be4-9ea2-4faf-9d5f-a4a85620a1dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:21.360939 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7469be4-9ea2-4faf-9d5f-a4a85620a1dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:21.362355 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7469be4-9ea2-4faf-9d5f-a4a85620a1dd service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:21.371826 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 465/950] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:22:21 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:22:24.050027 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fbed3-9763-437b-a389-a336b237dbe4 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:24.050641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fbed3-9763-437b-a389-a336b237dbe4 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:24.050641 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fbed3-9763-437b-a389-a336b237dbe4 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:24.052121 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 486/951] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:22:24.057044 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cf423-0479-4d71-9c96-19af4bade8c3 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:24.057421 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cf423-0479-4d71-9c96-19af4bade8c3 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:24.057604 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cf423-0479-4d71-9c96-19af4bade8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:24.065728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=62 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:24.078328 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-833cf423-0479-4d71-9c96-19af4bade8c3 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:24.079551 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-833cf423-0479-4d71-9c96-19af4bade8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:24.087530 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 466/952] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:22:24.427826 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fbed3-9763-437b-a389-a336b237dbe4 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:24.439653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fbed3-9763-437b-a389-a336b237dbe4 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:24.443264 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10458a5b-735f-4637-ac2c-d0dd40609109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:24.444550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10458a5b-735f-4637-ac2c-d0dd40609109 service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:24.444550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10458a5b-735f-4637-ac2c-d0dd40609109 service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:24.444550 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10458a5b-735f-4637-ac2c-d0dd40609109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:24.453658 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10458a5b-735f-4637-ac2c-d0dd40609109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:24.455138 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10458a5b-735f-4637-ac2c-d0dd40609109 service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:24.464769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 487/953] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:22:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:22:26.752005 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47511b64-8e3f-4d8c-82d0-4e180622f2ec None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:26.752461 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47511b64-8e3f-4d8c-82d0-4e180622f2ec None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:26.752581 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47511b64-8e3f-4d8c-82d0-4e180622f2ec None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:26.753880 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 467/954] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:26.759274 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33fac6-bee3-44d6-a44c-c1636aba3f03 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:26.759680 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33fac6-bee3-44d6-a44c-c1636aba3f03 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:26.759820 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33fac6-bee3-44d6-a44c-c1636aba3f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:26.778398 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-5f33fac6-bee3-44d6-a44c-c1636aba3f03 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:26.780328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-5f33fac6-bee3-44d6-a44c-c1636aba3f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:26.788286 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 488/955] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:22:27.171296 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47511b64-8e3f-4d8c-82d0-4e180622f2ec None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:27.182092 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47511b64-8e3f-4d8c-82d0-4e180622f2ec None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:27.187131 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe976e4d-f1a6-4606-b781-60434101eaf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:27.187805 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe976e4d-f1a6-4606-b781-60434101eaf9 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:27.188136 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe976e4d-f1a6-4606-b781-60434101eaf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:27.188302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe976e4d-f1a6-4606-b781-60434101eaf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:27.198493 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe976e4d-f1a6-4606-b781-60434101eaf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:27.199921 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe976e4d-f1a6-4606-b781-60434101eaf9 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:27.211121 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 468/956] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:22:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 19:22:30.139596 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2278dd2-bb67-4095-a856-b5bb22130013 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:30.140091 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2278dd2-bb67-4095-a856-b5bb22130013 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:30.140180 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2278dd2-bb67-4095-a856-b5bb22130013 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:30.141458 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 489/957] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:22:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:30.146512 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39379b06-fbc6-4a94-8175-a4a7b5a272ed None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:30.146932 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39379b06-fbc6-4a94-8175-a4a7b5a272ed None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:30.147193 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39379b06-fbc6-4a94-8175-a4a7b5a272ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:30.165936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-39379b06-fbc6-4a94-8175-a4a7b5a272ed None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:30.167169 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-39379b06-fbc6-4a94-8175-a4a7b5a272ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:30.175392 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 469/958] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:30 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:22:30.532753 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a768a7-d3d3-4816-83d0-5641c36dd759 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:30.533045 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a768a7-d3d3-4816-83d0-5641c36dd759 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:30.533315 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a768a7-d3d3-4816-83d0-5641c36dd759 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:30.534692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 490/959] 10.222.0.61 () {54 vars in 965 bytes} [Fri Aug 19 19:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:30.540874 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce3151-75d9-40fe-8bce-7fd84d08e683 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:30.541162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce3151-75d9-40fe-8bce-7fd84d08e683 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:30.541438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce3151-75d9-40fe-8bce-7fd84d08e683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:30.561371 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-36ce3151-75d9-40fe-8bce-7fd84d08e683 None None] MFA Rules not processed for user `84bd0bde9a164516a26768a3eb44fdec`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:30.562592 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-36ce3151-75d9-40fe-8bce-7fd84d08e683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:30.569216 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 470/960] 10.222.0.61 () {58 vars in 1062 bytes} [Fri Aug 19 19:22:30 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:22:30.578292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a768a7-d3d3-4816-83d0-5641c36dd759 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:30.583721 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:30.589518 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a768a7-d3d3-4816-83d0-5641c36dd759 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:30.593540 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d2981-fedc-49d5-bffe-2ef46c32a855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:30.595470 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d2981-fedc-49d5-bffe-2ef46c32a855 service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:30.595470 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d2981-fedc-49d5-bffe-2ef46c32a855 service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:30.595470 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d2981-fedc-49d5-bffe-2ef46c32a855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:30.603566 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d2981-fedc-49d5-bffe-2ef46c32a855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:30.604987 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d2981-fedc-49d5-bffe-2ef46c32a855 service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:30.615266 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 491/961] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:22:30 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:22:35.636939 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60690d-5f5d-4567-a664-2f4485f51ca5 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:35.638039 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60690d-5f5d-4567-a664-2f4485f51ca5 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:35.638207 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60690d-5f5d-4567-a664-2f4485f51ca5 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:35.639846 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 471/962] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:22:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:35.645353 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f2223-3da9-4af5-8ee7-e24f37de9ea9 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:35.645758 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f2223-3da9-4af5-8ee7-e24f37de9ea9 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:35.651671 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f2223-3da9-4af5-8ee7-e24f37de9ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:35.665623 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-658f2223-3da9-4af5-8ee7-e24f37de9ea9 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:35.667006 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-658f2223-3da9-4af5-8ee7-e24f37de9ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:35.675343 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 492/963] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:22:36.016271 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60690d-5f5d-4567-a664-2f4485f51ca5 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:36.026954 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60690d-5f5d-4567-a664-2f4485f51ca5 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:36.031223 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42a210-716f-445c-82a3-5e30caaaa6b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:36.031825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42a210-716f-445c-82a3-5e30caaaa6b3 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:36.032100 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42a210-716f-445c-82a3-5e30caaaa6b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:36.032372 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42a210-716f-445c-82a3-5e30caaaa6b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:36.041409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42a210-716f-445c-82a3-5e30caaaa6b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:36.042879 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42a210-716f-445c-82a3-5e30caaaa6b3 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:36.053601 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 472/964] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:22:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:22:39.358685 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187d621-29c8-4b6f-a86d-82c88fa06505 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:39.359275 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187d621-29c8-4b6f-a86d-82c88fa06505 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:39.359275 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187d621-29c8-4b6f-a86d-82c88fa06505 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:39.360584 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 493/965] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:22:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:39.365731 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f927e4-0eb4-4606-bf98-beb8bd12d552 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:39.366134 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f927e4-0eb4-4606-bf98-beb8bd12d552 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:39.366281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f927e4-0eb4-4606-bf98-beb8bd12d552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:39.388607 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-19f927e4-0eb4-4606-bf98-beb8bd12d552 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:39.389857 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-19f927e4-0eb4-4606-bf98-beb8bd12d552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:39.397714 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 473/966] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:39 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:22:39.756090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187d621-29c8-4b6f-a86d-82c88fa06505 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:39.767819 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187d621-29c8-4b6f-a86d-82c88fa06505 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:39.774800 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df12150-3e85-4be5-bc7e-42cc19e0b02d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:39.774800 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df12150-3e85-4be5-bc7e-42cc19e0b02d service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:39.774800 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df12150-3e85-4be5-bc7e-42cc19e0b02d service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:39.774800 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df12150-3e85-4be5-bc7e-42cc19e0b02d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:39.781814 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df12150-3e85-4be5-bc7e-42cc19e0b02d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:39.783269 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df12150-3e85-4be5-bc7e-42cc19e0b02d service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:39.792773 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 494/967] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:22:39 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:22:44.562480 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7cadd-052b-4b81-8d57-b580727a6ba1 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:44.563045 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7cadd-052b-4b81-8d57-b580727a6ba1 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:44.563045 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7cadd-052b-4b81-8d57-b580727a6ba1 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:44.564678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 474/968] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:44.570035 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c4edb-31ca-40b4-886b-c8bea9d3f8c3 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:44.570828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c4edb-31ca-40b4-886b-c8bea9d3f8c3 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:44.571296 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c4edb-31ca-40b4-886b-c8bea9d3f8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:44.590935 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-194c4edb-31ca-40b4-886b-c8bea9d3f8c3 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:44.592146 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-194c4edb-31ca-40b4-886b-c8bea9d3f8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:44.600377 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 495/969] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:22:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:22:44.940472 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7cadd-052b-4b81-8d57-b580727a6ba1 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:22:44.952324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7cadd-052b-4b81-8d57-b580727a6ba1 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:22:44.955802 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e128781-3586-4f60-b70e-632e6e061fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:22:44.956399 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e128781-3586-4f60-b70e-632e6e061fce service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:44.956668 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e128781-3586-4f60-b70e-632e6e061fce service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:44.956937 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e128781-3586-4f60-b70e-632e6e061fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:44.966551 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e128781-3586-4f60-b70e-632e6e061fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:22:44.968004 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e128781-3586-4f60-b70e-632e6e061fce service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:22:44.977581 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 475/970] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:22:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:22:50.556291 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22d360-0f4c-4fc3-b1cb-f936560b289e None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:50.556749 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22d360-0f4c-4fc3-b1cb-f936560b289e None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:50.556843 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22d360-0f4c-4fc3-b1cb-f936560b289e None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:50.564784 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 496/971] 10.222.0.61 () {54 vars in 921 bytes} [Fri Aug 19 19:22:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:50.762873 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f19058-d6e3-4980-b285-36f7e652d1cb None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:50.762873 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f19058-d6e3-4980-b285-36f7e652d1cb None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:50.762873 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f19058-d6e3-4980-b285-36f7e652d1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:50.762873 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-60f19058-d6e3-4980-b285-36f7e652d1cb None None] MFA Rules not processed for user `4aab18dc39cf4d119ba5f07fda334ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:50.762873 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-60f19058-d6e3-4980-b285-36f7e652d1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:50.762873 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 476/972] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Aug 19 19:22:50 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:22:54.586017 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=17 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:55.548402 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9996607-9221-42dd-9bc9-eb80d40b79ca None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:55.548834 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9996607-9221-42dd-9bc9-eb80d40b79ca None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:55.548954 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9996607-9221-42dd-9bc9-eb80d40b79ca None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:55.550540 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 497/973] 10.222.0.61 () {54 vars in 921 bytes} [Fri Aug 19 19:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:55.555689 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b479aa-20ac-4b3b-866c-438228a82526 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:55.556630 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b479aa-20ac-4b3b-866c-438228a82526 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:55.557130 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b479aa-20ac-4b3b-866c-438228a82526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:55.570128 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=69 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:22:55.587336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a0b479aa-20ac-4b3b-866c-438228a82526 None None] MFA Rules not processed for user `4aab18dc39cf4d119ba5f07fda334ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:55.588725 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a0b479aa-20ac-4b3b-866c-438228a82526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:55.598790 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 477/974] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Aug 19 19:22:55 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:22:57.026542 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e60cf9-5215-4549-9f74-e1d36abee96f None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:57.027039 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e60cf9-5215-4549-9f74-e1d36abee96f None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:57.027125 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e60cf9-5215-4549-9f74-e1d36abee96f None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:57.028474 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 498/975] 10.222.0.61 () {54 vars in 921 bytes} [Fri Aug 19 19:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:22:57.033419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed10df1-573c-4e22-9622-05f0bf93a3ab None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:22:57.033857 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed10df1-573c-4e22-9622-05f0bf93a3ab None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:22:57.033992 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed10df1-573c-4e22-9622-05f0bf93a3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:22:57.053415 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-aed10df1-573c-4e22-9622-05f0bf93a3ab None None] MFA Rules not processed for user `4aab18dc39cf4d119ba5f07fda334ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:22:57.054621 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-aed10df1-573c-4e22-9622-05f0bf93a3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:22:57.063693 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 478/976] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Aug 19 19:22:57 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:00.936694 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7f0a0-9b9e-4f0c-a62e-447105e2069e None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:00.937225 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7f0a0-9b9e-4f0c-a62e-447105e2069e None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:00.937225 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7f0a0-9b9e-4f0c-a62e-447105e2069e None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:00.940892 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 499/977] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:23:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:00.944575 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dcafb-dfd3-440a-b16b-dde8ddb02088 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:00.945017 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dcafb-dfd3-440a-b16b-dde8ddb02088 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:00.945147 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dcafb-dfd3-440a-b16b-dde8ddb02088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:00.972103 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c37dcafb-dfd3-440a-b16b-dde8ddb02088 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:00.973515 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c37dcafb-dfd3-440a-b16b-dde8ddb02088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:00.984923 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 479/978] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:01.355155 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dab8d-e2e8-4c45-9046-eb51f42e924d None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:01.355806 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dab8d-e2e8-4c45-9046-eb51f42e924d None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:01.356331 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dab8d-e2e8-4c45-9046-eb51f42e924d None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:01.358393 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 500/979] 10.222.0.61 () {54 vars in 962 bytes} [Fri Aug 19 19:23:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:01.366336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cab4c2-34a5-4d3b-aecc-c4d84be9d746 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:01.367075 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cab4c2-34a5-4d3b-aecc-c4d84be9d746 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:01.367557 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cab4c2-34a5-4d3b-aecc-c4d84be9d746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:01.426312 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c6cab4c2-34a5-4d3b-aecc-c4d84be9d746 None None] MFA Rules not processed for user `54c899e786614c18b2bf4334ceb2f891`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:01.427868 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c6cab4c2-34a5-4d3b-aecc-c4d84be9d746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:01.518266 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 480/980] 10.222.0.61 () {58 vars in 1059 bytes} [Fri Aug 19 19:23:01 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:23:01.526131 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dab8d-e2e8-4c45-9046-eb51f42e924d None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:01.542415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dab8d-e2e8-4c45-9046-eb51f42e924d None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:01.548470 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9369f5-cad7-4c29-a0b5-fbda158517b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:01.549075 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9369f5-cad7-4c29-a0b5-fbda158517b7 service nova] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:01.549385 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9369f5-cad7-4c29-a0b5-fbda158517b7 service nova] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:01.549626 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9369f5-cad7-4c29-a0b5-fbda158517b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:01.559202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9369f5-cad7-4c29-a0b5-fbda158517b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:01.561516 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9369f5-cad7-4c29-a0b5-fbda158517b7 service nova] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:01.573036 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 501/981] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 19:23:04.082854 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b53e9-f570-4c36-8744-9464a651a7d3 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:04.083373 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b53e9-f570-4c36-8744-9464a651a7d3 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:04.083661 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b53e9-f570-4c36-8744-9464a651a7d3 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:04.085402 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 481/982] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:04.091522 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a28fa-08e6-4c06-b187-e5bcd3d9cbd0 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:04.092504 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a28fa-08e6-4c06-b187-e5bcd3d9cbd0 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:04.092794 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a28fa-08e6-4c06-b187-e5bcd3d9cbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:04.113663 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-8f9a28fa-08e6-4c06-b187-e5bcd3d9cbd0 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:04.114915 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-8f9a28fa-08e6-4c06-b187-e5bcd3d9cbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:04.123093 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 502/983] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:23:04.471653 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b53e9-f570-4c36-8744-9464a651a7d3 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:04.487723 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b53e9-f570-4c36-8744-9464a651a7d3 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:04.493143 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ce8df-9f94-439c-b2a3-93428f3d8ad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:04.493743 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ce8df-9f94-439c-b2a3-93428f3d8ad8 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:04.494140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ce8df-9f94-439c-b2a3-93428f3d8ad8 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:04.494416 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ce8df-9f94-439c-b2a3-93428f3d8ad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:04.504360 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ce8df-9f94-439c-b2a3-93428f3d8ad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:04.505959 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ce8df-9f94-439c-b2a3-93428f3d8ad8 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:04.517330 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 482/984] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:07.220685 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5243e-aa45-4493-9d64-928a2dc904a0 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:07.221095 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5243e-aa45-4493-9d64-928a2dc904a0 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:07.221233 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5243e-aa45-4493-9d64-928a2dc904a0 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:07.222832 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 503/985] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:07.228113 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05f672-c025-4694-aec3-126d66493c1f None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:07.228494 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05f672-c025-4694-aec3-126d66493c1f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:07.228708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05f672-c025-4694-aec3-126d66493c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:07.251048 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-5b05f672-c025-4694-aec3-126d66493c1f None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:07.251832 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5b05f672-c025-4694-aec3-126d66493c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:07.263613 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 483/986] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:07.618813 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04a8e7-e041-4c44-bbf6-e5e56e89f7b4 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:07.619347 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04a8e7-e041-4c44-bbf6-e5e56e89f7b4 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:07.619628 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04a8e7-e041-4c44-bbf6-e5e56e89f7b4 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:07.621520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 504/987] 10.222.0.61 () {54 vars in 962 bytes} [Fri Aug 19 19:23:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:07.627578 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a631f3a-5ef0-482d-8e1a-43119e6b79eb None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:07.627870 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a631f3a-5ef0-482d-8e1a-43119e6b79eb None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:07.628148 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a631f3a-5ef0-482d-8e1a-43119e6b79eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:07.650676 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-2a631f3a-5ef0-482d-8e1a-43119e6b79eb None None] MFA Rules not processed for user `54c899e786614c18b2bf4334ceb2f891`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:07.652414 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-2a631f3a-5ef0-482d-8e1a-43119e6b79eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:07.667240 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 484/988] 10.222.0.61 () {58 vars in 1059 bytes} [Fri Aug 19 19:23:07 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:07.671310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04a8e7-e041-4c44-bbf6-e5e56e89f7b4 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:07.689376 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04a8e7-e041-4c44-bbf6-e5e56e89f7b4 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:07.695696 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4dda4-05e1-49cf-8913-ba30ab643c40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:07.696333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4dda4-05e1-49cf-8913-ba30ab643c40 service nova] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:07.696608 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4dda4-05e1-49cf-8913-ba30ab643c40 service nova] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:07.696876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4dda4-05e1-49cf-8913-ba30ab643c40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:07.707638 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4dda4-05e1-49cf-8913-ba30ab643c40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:07.709250 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4dda4-05e1-49cf-8913-ba30ab643c40 service nova] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:07.722704 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 505/989] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:10.348391 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d2053-a434-4c9d-b1b4-64524d377d64 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:10.349470 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d2053-a434-4c9d-b1b4-64524d377d64 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:10.349987 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d2053-a434-4c9d-b1b4-64524d377d64 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:10.357657 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615c31-ccf4-44a7-b096-190be85bcaf7 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:10.358586 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615c31-ccf4-44a7-b096-190be85bcaf7 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:10.359082 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615c31-ccf4-44a7-b096-190be85bcaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:10.361214 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 485/990] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:23:10 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:10.382574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-47615c31-ccf4-44a7-b096-190be85bcaf7 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:10.384203 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-47615c31-ccf4-44a7-b096-190be85bcaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:10.402297 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 506/991] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:10.771812 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d2053-a434-4c9d-b1b4-64524d377d64 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:10.789649 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d2053-a434-4c9d-b1b4-64524d377d64 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:10.796076 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547566c1-bbf8-4454-8f26-a139ad62eefa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:10.797128 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547566c1-bbf8-4454-8f26-a139ad62eefa service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:10.797634 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547566c1-bbf8-4454-8f26-a139ad62eefa service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:10.798085 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547566c1-bbf8-4454-8f26-a139ad62eefa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:10.807713 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547566c1-bbf8-4454-8f26-a139ad62eefa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:10.810640 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547566c1-bbf8-4454-8f26-a139ad62eefa service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:10.835973 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 486/992] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:11.452483 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd8b67-8725-454f-a030-bb310c8ccc81 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:11.452932 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd8b67-8725-454f-a030-bb310c8ccc81 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:11.453011 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd8b67-8725-454f-a030-bb310c8ccc81 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:11.454792 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 507/993] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:11.460761 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a5592-ba1e-4570-91a0-3dde4a76bd55 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:11.461891 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a5592-ba1e-4570-91a0-3dde4a76bd55 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:11.462462 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a5592-ba1e-4570-91a0-3dde4a76bd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:11.491231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-184a5592-ba1e-4570-91a0-3dde4a76bd55 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:11.492437 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-184a5592-ba1e-4570-91a0-3dde4a76bd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:11.515002 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 487/994] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:12.115824 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488bfdc-ae7f-4151-a4cc-105b5d2a3430 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:12.116106 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488bfdc-ae7f-4151-a4cc-105b5d2a3430 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:12.116554 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488bfdc-ae7f-4151-a4cc-105b5d2a3430 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:12.117883 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 508/995] 10.222.0.61 () {54 vars in 964 bytes} [Fri Aug 19 19:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:12.123969 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feab964-2199-4635-aa26-8cd77fe28e54 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:12.124328 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feab964-2199-4635-aa26-8cd77fe28e54 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:12.124671 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feab964-2199-4635-aa26-8cd77fe28e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:12.179068 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-1feab964-2199-4635-aa26-8cd77fe28e54 None None] MFA Rules not processed for user `23bbd8bfe6924ea2a6fd35513f830cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:12.180345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1feab964-2199-4635-aa26-8cd77fe28e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:12.212639 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:12.245199 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 488/996] 10.222.0.61 () {58 vars in 1061 bytes} [Fri Aug 19 19:23:12 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:12.253052 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488bfdc-ae7f-4151-a4cc-105b5d2a3430 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:12.264929 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488bfdc-ae7f-4151-a4cc-105b5d2a3430 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:12.268469 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b378a1-c896-41d7-9f59-7d1de3131a98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23bbd8bfe6924ea2a6fd35513f830cb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:12.269137 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b378a1-c896-41d7-9f59-7d1de3131a98 service cinder] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:12.269483 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b378a1-c896-41d7-9f59-7d1de3131a98 service cinder] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:12.269816 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b378a1-c896-41d7-9f59-7d1de3131a98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:12.280661 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b378a1-c896-41d7-9f59-7d1de3131a98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:12.282191 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b378a1-c896-41d7-9f59-7d1de3131a98 service cinder] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:12.293421 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 509/997] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:13.355995 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df47cac-bd37-4c9c-88f0-217f4becd8e0 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:13.357561 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df47cac-bd37-4c9c-88f0-217f4becd8e0 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:13.358395 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df47cac-bd37-4c9c-88f0-217f4becd8e0 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:13.363382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 489/998] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:23:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:13.366982 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7c383-1b6b-414e-866a-ff6b184ae190 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:13.368064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7c383-1b6b-414e-866a-ff6b184ae190 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:13.368285 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7c383-1b6b-414e-866a-ff6b184ae190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:13.391694 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-2aa7c383-1b6b-414e-866a-ff6b184ae190 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:13.392972 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-2aa7c383-1b6b-414e-866a-ff6b184ae190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:13.415031 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 510/999] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:13.769830 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df47cac-bd37-4c9c-88f0-217f4becd8e0 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:13.784043 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df47cac-bd37-4c9c-88f0-217f4becd8e0 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:13.789189 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdcf77a-81e1-4554-b60b-4e90832f6671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:13.789780 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcf77a-81e1-4554-b60b-4e90832f6671 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:13.791649 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcf77a-81e1-4554-b60b-4e90832f6671 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:13.791649 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcf77a-81e1-4554-b60b-4e90832f6671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:13.799900 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdcf77a-81e1-4554-b60b-4e90832f6671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:13.801555 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdcf77a-81e1-4554-b60b-4e90832f6671 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:13.812367 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 490/1000] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:16.146366 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb6114-b0ba-4ba7-a71a-285314b9c25a None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:16.146900 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb6114-b0ba-4ba7-a71a-285314b9c25a None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:16.147011 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb6114-b0ba-4ba7-a71a-285314b9c25a None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:16.148290 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 511/1001] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:16.154247 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0f69d-e876-430b-8bfd-1d15516a6e5e None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:16.154703 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0f69d-e876-430b-8bfd-1d15516a6e5e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:16.154971 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0f69d-e876-430b-8bfd-1d15516a6e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:16.174358 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-5fc0f69d-e876-430b-8bfd-1d15516a6e5e None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:16.175590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5fc0f69d-e876-430b-8bfd-1d15516a6e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:16.183617 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 491/1002] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:16.541389 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb6114-b0ba-4ba7-a71a-285314b9c25a None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:16.558469 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb6114-b0ba-4ba7-a71a-285314b9c25a None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:16.567572 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08e4bb-5c2e-4c88-a3df-ca3bfc4a4999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:16.569270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08e4bb-5c2e-4c88-a3df-ca3bfc4a4999 service nova] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:16.569963 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08e4bb-5c2e-4c88-a3df-ca3bfc4a4999 service nova] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:16.570907 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08e4bb-5c2e-4c88-a3df-ca3bfc4a4999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:16.589263 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08e4bb-5c2e-4c88-a3df-ca3bfc4a4999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:16.592546 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08e4bb-5c2e-4c88-a3df-ca3bfc4a4999 service nova] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:16.610429 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 512/1003] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:19.041593 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e775b-cc82-48d3-a0f3-b5e724b95031 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:19.043060 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e775b-cc82-48d3-a0f3-b5e724b95031 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:19.043491 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e775b-cc82-48d3-a0f3-b5e724b95031 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:19.045629 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 492/1004] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:23:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:19.050497 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d2784-1474-4240-a318-c2fb591fb538 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:19.050961 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d2784-1474-4240-a318-c2fb591fb538 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:19.051258 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d2784-1474-4240-a318-c2fb591fb538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:19.071220 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-cd7d2784-1474-4240-a318-c2fb591fb538 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:19.072555 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-cd7d2784-1474-4240-a318-c2fb591fb538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:19.081339 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 513/1005] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:19.432378 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e775b-cc82-48d3-a0f3-b5e724b95031 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:19.447759 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e775b-cc82-48d3-a0f3-b5e724b95031 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:19.453384 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f854b-5fd8-48d5-91af-a4c4240ebc98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:19.453990 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f854b-5fd8-48d5-91af-a4c4240ebc98 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:19.454266 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f854b-5fd8-48d5-91af-a4c4240ebc98 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:19.454625 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f854b-5fd8-48d5-91af-a4c4240ebc98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:19.463351 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f854b-5fd8-48d5-91af-a4c4240ebc98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:19.465423 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f854b-5fd8-48d5-91af-a4c4240ebc98 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:19.475682 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 493/1006] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:21.708478 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7149d-e390-499c-9587-36907c831135 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:21.709016 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7149d-e390-499c-9587-36907c831135 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:21.709016 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7149d-e390-499c-9587-36907c831135 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:21.710466 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 514/1007] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:21.716588 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b7377-fb84-4aa3-a631-f3fc65ee9e95 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:21.717105 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b7377-fb84-4aa3-a631-f3fc65ee9e95 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:21.717105 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b7377-fb84-4aa3-a631-f3fc65ee9e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:21.736948 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-fe1b7377-fb84-4aa3-a631-f3fc65ee9e95 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:21.738162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-fe1b7377-fb84-4aa3-a631-f3fc65ee9e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:21.746109 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 494/1008] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:22.119248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7149d-e390-499c-9587-36907c831135 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:22.167505 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7149d-e390-499c-9587-36907c831135 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:22.167505 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2ef5b-e869-42ea-8b94-e817503ae12a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:22.167505 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2ef5b-e869-42ea-8b94-e817503ae12a service nova] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:22.167505 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2ef5b-e869-42ea-8b94-e817503ae12a service nova] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:22.168473 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2ef5b-e869-42ea-8b94-e817503ae12a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:22.168473 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2ef5b-e869-42ea-8b94-e817503ae12a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:22.168473 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2ef5b-e869-42ea-8b94-e817503ae12a service nova] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:22.168473 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 515/1009] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:25.475706 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb1299-8835-472d-916e-154edf9556fb None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:25.476738 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb1299-8835-472d-916e-154edf9556fb None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:25.476738 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb1299-8835-472d-916e-154edf9556fb None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:25.477595 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 495/1010] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:23:25.483199 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e121b1-b633-4ab1-8504-4a8bcedb3eb3 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:25.483736 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e121b1-b633-4ab1-8504-4a8bcedb3eb3 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:25.483736 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e121b1-b633-4ab1-8504-4a8bcedb3eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:25.491805 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=43 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:25.503939 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-45e121b1-b633-4ab1-8504-4a8bcedb3eb3 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:25.505139 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-45e121b1-b633-4ab1-8504-4a8bcedb3eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:25.513734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 516/1011] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:23:25.877911 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb1299-8835-472d-916e-154edf9556fb None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:25.892459 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb1299-8835-472d-916e-154edf9556fb None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:25.897377 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f336695-652a-445b-b812-1b9232e1b8e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:25.897984 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f336695-652a-445b-b812-1b9232e1b8e4 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:25.898262 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f336695-652a-445b-b812-1b9232e1b8e4 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:25.898548 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f336695-652a-445b-b812-1b9232e1b8e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:25.908440 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f336695-652a-445b-b812-1b9232e1b8e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:25.910029 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f336695-652a-445b-b812-1b9232e1b8e4 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:25.920940 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 496/1012] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 19:23:28.413265 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80de19c-af5d-4db5-bc8e-30064817ff99 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:28.413873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80de19c-af5d-4db5-bc8e-30064817ff99 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:28.413873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80de19c-af5d-4db5-bc8e-30064817ff99 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:28.415193 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 517/1013] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:23:28.421094 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b50f65-7447-40a4-a008-32edb3bdeae4 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:28.421533 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b50f65-7447-40a4-a008-32edb3bdeae4 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:28.421633 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b50f65-7447-40a4-a008-32edb3bdeae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:28.441294 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-f9b50f65-7447-40a4-a008-32edb3bdeae4 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:28.442491 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f9b50f65-7447-40a4-a008-32edb3bdeae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:28.451491 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 497/1014] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:28.738269 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7df44f-48d5-4813-8f0e-cae080e2b3b1 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:28.738475 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7df44f-48d5-4813-8f0e-cae080e2b3b1 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:28.738801 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7df44f-48d5-4813-8f0e-cae080e2b3b1 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:28.740675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 518/1015] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:23:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:28.750316 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5aebc5-7f7b-483c-b8dc-fa86c9e953d3 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:28.750632 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5aebc5-7f7b-483c-b8dc-fa86c9e953d3 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:28.750926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5aebc5-7f7b-483c-b8dc-fa86c9e953d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:28.770665 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ce5aebc5-7f7b-483c-b8dc-fa86c9e953d3 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:28.772016 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ce5aebc5-7f7b-483c-b8dc-fa86c9e953d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:28.779952 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 498/1016] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:28.804265 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7df44f-48d5-4813-8f0e-cae080e2b3b1 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:28.819026 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7df44f-48d5-4813-8f0e-cae080e2b3b1 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:28.825043 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4136be5-0399-4f8f-92ce-a2e35b372442 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:28.825703 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4136be5-0399-4f8f-92ce-a2e35b372442 service nova] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:28.826015 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4136be5-0399-4f8f-92ce-a2e35b372442 service nova] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:28.826283 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4136be5-0399-4f8f-92ce-a2e35b372442 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:28.834761 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4136be5-0399-4f8f-92ce-a2e35b372442 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:28.836352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4136be5-0399-4f8f-92ce-a2e35b372442 service nova] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:28.846590 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 519/1017] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:29.148288 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b082f-8d93-4dc9-8ad7-b7286f936278 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:29.148577 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b082f-8d93-4dc9-8ad7-b7286f936278 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:29.148926 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b082f-8d93-4dc9-8ad7-b7286f936278 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:29.150278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 499/1018] 10.222.0.61 () {54 vars in 967 bytes} [Fri Aug 19 19:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:29.156038 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bf3dc-1ab8-447d-ba5f-f6a313439dfe None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:29.156325 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bf3dc-1ab8-447d-ba5f-f6a313439dfe None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:29.156602 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bf3dc-1ab8-447d-ba5f-f6a313439dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:29.211732 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-946bf3dc-1ab8-447d-ba5f-f6a313439dfe None None] MFA Rules not processed for user `1bca70a332304359bcc9d873ebbe14de`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:29.212964 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-946bf3dc-1ab8-447d-ba5f-f6a313439dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:29.274937 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 520/1019] 10.222.0.61 () {58 vars in 1064 bytes} [Fri Aug 19 19:23:29 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:29.282985 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b082f-8d93-4dc9-8ad7-b7286f936278 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:29.294281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b082f-8d93-4dc9-8ad7-b7286f936278 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:29.297813 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a9943-d698-414c-b5e1-c4af3d49c2de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bca70a332304359bcc9d873ebbe14de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:29.298496 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a9943-d698-414c-b5e1-c4af3d49c2de service glance] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:29.298806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a9943-d698-414c-b5e1-c4af3d49c2de service glance] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:29.299075 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a9943-d698-414c-b5e1-c4af3d49c2de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:29.308703 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a9943-d698-414c-b5e1-c4af3d49c2de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:29.310160 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a9943-d698-414c-b5e1-c4af3d49c2de service glance] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:29.320695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 500/1020] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:31.304645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240e92c-db40-442a-be9b-3ad39f71182d None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:31.305268 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240e92c-db40-442a-be9b-3ad39f71182d None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:31.305268 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240e92c-db40-442a-be9b-3ad39f71182d None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:31.306546 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 521/1021] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:31.312234 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42b46c-a7c1-40c9-879a-0bc0c958b517 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:31.312756 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42b46c-a7c1-40c9-879a-0bc0c958b517 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:31.312868 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42b46c-a7c1-40c9-879a-0bc0c958b517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:31.336237 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-af42b46c-a7c1-40c9-879a-0bc0c958b517 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:31.337777 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-af42b46c-a7c1-40c9-879a-0bc0c958b517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:31.346346 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 501/1022] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:31.696049 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240e92c-db40-442a-be9b-3ad39f71182d None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:31.711727 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240e92c-db40-442a-be9b-3ad39f71182d None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:31.717297 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480f45b-a4e2-4219-a1c8-80ad6697f363 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:31.717914 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480f45b-a4e2-4219-a1c8-80ad6697f363 service nova] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:31.718192 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480f45b-a4e2-4219-a1c8-80ad6697f363 service nova] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:31.718483 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480f45b-a4e2-4219-a1c8-80ad6697f363 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:31.727601 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480f45b-a4e2-4219-a1c8-80ad6697f363 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:31.729407 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480f45b-a4e2-4219-a1c8-80ad6697f363 service nova] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:31.739451 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 522/1023] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:34.210243 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d95c68-20f8-4693-b87b-6ea388d2ad9a None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:34.210846 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d95c68-20f8-4693-b87b-6ea388d2ad9a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:34.210846 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d95c68-20f8-4693-b87b-6ea388d2ad9a None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:34.212353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 502/1024] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:34.218019 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df14931-73f1-4394-a114-908eb6fd6097 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:34.218621 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df14931-73f1-4394-a114-908eb6fd6097 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:34.218621 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df14931-73f1-4394-a114-908eb6fd6097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:34.240638 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-4df14931-73f1-4394-a114-908eb6fd6097 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:34.242499 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-4df14931-73f1-4394-a114-908eb6fd6097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:34.250908 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 523/1025] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:23:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:34.597930 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d95c68-20f8-4693-b87b-6ea388d2ad9a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:34.612096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d95c68-20f8-4693-b87b-6ea388d2ad9a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:34.616948 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec8a57-e9f7-4916-98ff-df66294550c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:34.617551 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec8a57-e9f7-4916-98ff-df66294550c7 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:34.617825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec8a57-e9f7-4916-98ff-df66294550c7 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:34.618091 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec8a57-e9f7-4916-98ff-df66294550c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:34.627458 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec8a57-e9f7-4916-98ff-df66294550c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:34.629046 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec8a57-e9f7-4916-98ff-df66294550c7 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:34.639300 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 503/1026] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:44.233518 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=55 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:44.634462 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=56 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:23:45.382300 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73769-4974-4417-b1f5-e5c8bc4ca7e2 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:45.382921 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73769-4974-4417-b1f5-e5c8bc4ca7e2 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:45.382921 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73769-4974-4417-b1f5-e5c8bc4ca7e2 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:45.384271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 524/1027] 10.222.0.61 () {54 vars in 918 bytes} [Fri Aug 19 19:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:45.389497 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cf930-eb51-4c35-aa1e-4e774753ad89 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:45.389781 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cf930-eb51-4c35-aa1e-4e774753ad89 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:45.390054 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cf930-eb51-4c35-aa1e-4e774753ad89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:45.410582 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-ac7cf930-eb51-4c35-aa1e-4e774753ad89 None None] MFA Rules not processed for user `4aab18dc39cf4d119ba5f07fda334ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:45.411799 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ac7cf930-eb51-4c35-aa1e-4e774753ad89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:45.421924 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 504/1028] 10.222.0.61 () {58 vars in 1015 bytes} [Fri Aug 19 19:23:45 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:45.436647 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e4f72-8fce-48f7-968d-80a83c50c19f None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:45.436979 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e4f72-8fce-48f7-968d-80a83c50c19f None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:45.437254 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e4f72-8fce-48f7-968d-80a83c50c19f None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:45.438613 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 525/1029] 10.222.0.61 () {54 vars in 918 bytes} [Fri Aug 19 19:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:45.443383 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1c510-9a76-439f-8504-3c7bd9047f1b None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:45.443665 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1c510-9a76-439f-8504-3c7bd9047f1b None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:45.443936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1c510-9a76-439f-8504-3c7bd9047f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:45.464417 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-d6c1c510-9a76-439f-8504-3c7bd9047f1b None None] MFA Rules not processed for user `54c899e786614c18b2bf4334ceb2f891`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:45.465614 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d6c1c510-9a76-439f-8504-3c7bd9047f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:45.473928 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 505/1030] 10.222.0.61 () {58 vars in 1015 bytes} [Fri Aug 19 19:23:45 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:48.152233 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a696f3-b9ef-4a76-8e17-3e6f4586cbb3 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:48.152805 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a696f3-b9ef-4a76-8e17-3e6f4586cbb3 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:48.152805 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a696f3-b9ef-4a76-8e17-3e6f4586cbb3 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:48.154165 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 526/1031] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:48.159317 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16f6db-cfd3-4483-ba06-304d6808e344 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:48.159733 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16f6db-cfd3-4483-ba06-304d6808e344 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:48.159867 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16f6db-cfd3-4483-ba06-304d6808e344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:48.178878 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-4d16f6db-cfd3-4483-ba06-304d6808e344 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:48.180058 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4d16f6db-cfd3-4483-ba06-304d6808e344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:48.188278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 506/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:23:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:48.534563 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a696f3-b9ef-4a76-8e17-3e6f4586cbb3 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:48.548310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a696f3-b9ef-4a76-8e17-3e6f4586cbb3 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:48.553205 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17313799-3554-47ee-9874-8ec258b38c56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:48.553790 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17313799-3554-47ee-9874-8ec258b38c56 service nova] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:48.554065 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17313799-3554-47ee-9874-8ec258b38c56 service nova] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:48.554333 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17313799-3554-47ee-9874-8ec258b38c56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:48.562740 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17313799-3554-47ee-9874-8ec258b38c56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:48.564597 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17313799-3554-47ee-9874-8ec258b38c56 service nova] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:48.575224 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 527/1033] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:49.539055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e9692-1047-4c58-89f3-277ae6c4f9bf None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:49.539609 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e9692-1047-4c58-89f3-277ae6c4f9bf None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:49.539881 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e9692-1047-4c58-89f3-277ae6c4f9bf None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:49.541482 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 507/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:23:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:49.546584 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb767a-9a8d-46f4-8f12-4bd6994ae00f None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:49.547007 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb767a-9a8d-46f4-8f12-4bd6994ae00f None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:49.547108 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb767a-9a8d-46f4-8f12-4bd6994ae00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:49.567084 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-f3bb767a-9a8d-46f4-8f12-4bd6994ae00f None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:49.568380 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-f3bb767a-9a8d-46f4-8f12-4bd6994ae00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:49.578161 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 528/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:23:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:49.768146 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e9692-1047-4c58-89f3-277ae6c4f9bf None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:49.781813 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e9692-1047-4c58-89f3-277ae6c4f9bf None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:49.786755 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf53f5-2784-4a03-90d6-0ec40e7687d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:49.787343 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf53f5-2784-4a03-90d6-0ec40e7687d3 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:49.787620 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf53f5-2784-4a03-90d6-0ec40e7687d3 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:49.787890 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf53f5-2784-4a03-90d6-0ec40e7687d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:49.799287 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf53f5-2784-4a03-90d6-0ec40e7687d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:49.799287 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf53f5-2784-4a03-90d6-0ec40e7687d3 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:49.808898 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 508/1036] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:50.785273 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c39b14-d11d-4a8d-80e1-d482e550f9cc None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:50.785808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c39b14-d11d-4a8d-80e1-d482e550f9cc None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:50.785808 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c39b14-d11d-4a8d-80e1-d482e550f9cc None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:50.787202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 529/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:50.792760 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e9fa3-54db-4e73-b134-c61daeca3840 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:50.793162 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e9fa3-54db-4e73-b134-c61daeca3840 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:50.793302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e9fa3-54db-4e73-b134-c61daeca3840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:50.812207 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-bc1e9fa3-54db-4e73-b134-c61daeca3840 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:50.813402 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-bc1e9fa3-54db-4e73-b134-c61daeca3840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:50.821469 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 509/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:23:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:50.979068 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c39b14-d11d-4a8d-80e1-d482e550f9cc None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:50.992290 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c39b14-d11d-4a8d-80e1-d482e550f9cc None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:50.998506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e7a33-1167-4937-9429-d8e1dcdf3d9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:50.999128 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e7a33-1167-4937-9429-d8e1dcdf3d9b service nova] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:50.999404 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e7a33-1167-4937-9429-d8e1dcdf3d9b service nova] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:50.999676 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e7a33-1167-4937-9429-d8e1dcdf3d9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:51.008181 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e7a33-1167-4937-9429-d8e1dcdf3d9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:51.010569 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e7a33-1167-4937-9429-d8e1dcdf3d9b service nova] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:51.021049 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 530/1039] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:51.913963 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7016d9d-f32a-42a8-a3db-ca9d0eea92ab None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:51.914663 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7016d9d-f32a-42a8-a3db-ca9d0eea92ab None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:51.914663 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7016d9d-f32a-42a8-a3db-ca9d0eea92ab None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:51.916117 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 510/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:23:51.921219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e47ab-d6cc-43e9-82ec-1e35d3e091ce None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:51.921789 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e47ab-d6cc-43e9-82ec-1e35d3e091ce None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:51.921789 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e47ab-d6cc-43e9-82ec-1e35d3e091ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:51.942503 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-435e47ab-d6cc-43e9-82ec-1e35d3e091ce None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:51.943812 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-435e47ab-d6cc-43e9-82ec-1e35d3e091ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:51.952525 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 531/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:23:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:52.119616 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7016d9d-f32a-42a8-a3db-ca9d0eea92ab None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:52.133012 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7016d9d-f32a-42a8-a3db-ca9d0eea92ab None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:52.138573 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032d41e-d568-4f52-bb31-a0e3232cff62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:52.145652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032d41e-d568-4f52-bb31-a0e3232cff62 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:52.145652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032d41e-d568-4f52-bb31-a0e3232cff62 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:52.145652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032d41e-d568-4f52-bb31-a0e3232cff62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:52.147681 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032d41e-d568-4f52-bb31-a0e3232cff62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:52.149332 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032d41e-d568-4f52-bb31-a0e3232cff62 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:52.158654 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 511/1042] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:53.041202 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033a2dd-aa42-4630-9dd9-5f39f4d0f400 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:53.041771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033a2dd-aa42-4630-9dd9-5f39f4d0f400 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:53.041878 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033a2dd-aa42-4630-9dd9-5f39f4d0f400 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:53.043252 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 532/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:53.048192 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a5747-dc2f-45ac-9a89-6085aa3a5c4e None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:53.048639 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a5747-dc2f-45ac-9a89-6085aa3a5c4e None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:53.048745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a5747-dc2f-45ac-9a89-6085aa3a5c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:53.068481 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-1a4a5747-dc2f-45ac-9a89-6085aa3a5c4e None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:53.069678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1a4a5747-dc2f-45ac-9a89-6085aa3a5c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:53.078217 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 512/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:23:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:53.240147 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033a2dd-aa42-4630-9dd9-5f39f4d0f400 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:53.254538 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033a2dd-aa42-4630-9dd9-5f39f4d0f400 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:53.260174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a676d6-690f-4bf8-b84e-4ea430bbfcee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:53.261160 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a676d6-690f-4bf8-b84e-4ea430bbfcee service nova] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:53.261618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a676d6-690f-4bf8-b84e-4ea430bbfcee service nova] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:53.261983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a676d6-690f-4bf8-b84e-4ea430bbfcee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:53.271029 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a676d6-690f-4bf8-b84e-4ea430bbfcee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:53.272848 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a676d6-690f-4bf8-b84e-4ea430bbfcee service nova] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:53.283839 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 533/1045] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:54.193336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b3d7f-7f1b-495a-8c89-df9d5e898234 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:54.193930 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b3d7f-7f1b-495a-8c89-df9d5e898234 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:54.193930 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b3d7f-7f1b-495a-8c89-df9d5e898234 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:54.195286 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 513/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:54.200770 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c04b42-5013-4cb2-a77d-7481b1e04fc2 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:54.201243 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c04b42-5013-4cb2-a77d-7481b1e04fc2 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:54.201344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c04b42-5013-4cb2-a77d-7481b1e04fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:54.220402 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-b1c04b42-5013-4cb2-a77d-7481b1e04fc2 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:54.221607 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-b1c04b42-5013-4cb2-a77d-7481b1e04fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:54.229532 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 534/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:23:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:54.385562 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b3d7f-7f1b-495a-8c89-df9d5e898234 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:54.398631 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b3d7f-7f1b-495a-8c89-df9d5e898234 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:54.403646 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798f723-d2e7-46b5-83a7-d86a94ae845f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:54.404231 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798f723-d2e7-46b5-83a7-d86a94ae845f service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:54.404502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798f723-d2e7-46b5-83a7-d86a94ae845f service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:54.404766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798f723-d2e7-46b5-83a7-d86a94ae845f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:54.412988 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798f723-d2e7-46b5-83a7-d86a94ae845f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:54.414592 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798f723-d2e7-46b5-83a7-d86a94ae845f service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:54.423871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 514/1048] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:55.342490 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010edf48-3f69-4832-a5e5-ede0108b762e None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:55.343061 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010edf48-3f69-4832-a5e5-ede0108b762e None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:55.343061 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010edf48-3f69-4832-a5e5-ede0108b762e None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:55.344431 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 535/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:55.349611 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee232b-6b37-440d-a915-7c30bf646c0a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:55.349989 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee232b-6b37-440d-a915-7c30bf646c0a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:55.350149 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee232b-6b37-440d-a915-7c30bf646c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:55.369067 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-4dee232b-6b37-440d-a915-7c30bf646c0a None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:55.370240 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4dee232b-6b37-440d-a915-7c30bf646c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:55.377913 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 515/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:23:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:55.534051 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010edf48-3f69-4832-a5e5-ede0108b762e None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:55.548109 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010edf48-3f69-4832-a5e5-ede0108b762e None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:55.553017 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832be97-059b-4ef7-bac8-f2ef1688c8b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:55.553607 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832be97-059b-4ef7-bac8-f2ef1688c8b6 service nova] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:55.553887 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832be97-059b-4ef7-bac8-f2ef1688c8b6 service nova] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:55.554161 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832be97-059b-4ef7-bac8-f2ef1688c8b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:55.563238 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832be97-059b-4ef7-bac8-f2ef1688c8b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:55.565094 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832be97-059b-4ef7-bac8-f2ef1688c8b6 service nova] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:55.574779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 536/1051] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:56.457742 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1eb04a-c743-4d93-a2bb-5c08ba040d03 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:56.458312 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1eb04a-c743-4d93-a2bb-5c08ba040d03 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:56.458312 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1eb04a-c743-4d93-a2bb-5c08ba040d03 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:56.459657 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 516/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:56.464676 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4e631-bda4-4044-ab3f-16994f8d6764 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:56.465114 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4e631-bda4-4044-ab3f-16994f8d6764 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:56.465225 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4e631-bda4-4044-ab3f-16994f8d6764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:56.484436 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-f7f4e631-bda4-4044-ab3f-16994f8d6764 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:56.485621 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-f7f4e631-bda4-4044-ab3f-16994f8d6764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:56.493354 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 537/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:23:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:56.648704 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1eb04a-c743-4d93-a2bb-5c08ba040d03 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:56.662672 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1eb04a-c743-4d93-a2bb-5c08ba040d03 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:56.667860 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c948db-d81e-4190-9045-30bb241c2bcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:56.668452 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c948db-d81e-4190-9045-30bb241c2bcd service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:56.668728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c948db-d81e-4190-9045-30bb241c2bcd service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:56.668997 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c948db-d81e-4190-9045-30bb241c2bcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:56.676899 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c948db-d81e-4190-9045-30bb241c2bcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:56.678483 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c948db-d81e-4190-9045-30bb241c2bcd service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:56.688892 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 517/1054] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:57.597835 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c636e96-55a1-41f0-bf8c-b335567fa1f9 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:57.598338 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c636e96-55a1-41f0-bf8c-b335567fa1f9 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:57.598434 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c636e96-55a1-41f0-bf8c-b335567fa1f9 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:57.599734 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 538/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:57.604761 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0e716-7903-4bb3-b507-75385c6e7d8f None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:57.605171 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0e716-7903-4bb3-b507-75385c6e7d8f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:57.605299 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0e716-7903-4bb3-b507-75385c6e7d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:57.624314 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-5db0e716-7903-4bb3-b507-75385c6e7d8f None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:57.625512 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-5db0e716-7903-4bb3-b507-75385c6e7d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:57.633557 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 518/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:23:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:23:57.809398 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c636e96-55a1-41f0-bf8c-b335567fa1f9 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:23:57.823692 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c636e96-55a1-41f0-bf8c-b335567fa1f9 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:23:57.828769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751b76f-53f3-41b1-859e-a8fc746918bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:23:57.829297 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751b76f-53f3-41b1-859e-a8fc746918bf service nova] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:57.829576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751b76f-53f3-41b1-859e-a8fc746918bf service nova] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:57.829844 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751b76f-53f3-41b1-859e-a8fc746918bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:57.838458 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751b76f-53f3-41b1-859e-a8fc746918bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:23:57.840092 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751b76f-53f3-41b1-859e-a8fc746918bf service nova] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:23:57.849386 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 539/1057] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:23:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:23:59.919490 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6b8f7-97c1-4722-9464-599eeb1083b8 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:59.920041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6b8f7-97c1-4722-9464-599eeb1083b8 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:59.920041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6b8f7-97c1-4722-9464-599eeb1083b8 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:59.921289 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 519/1058] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:23:59.926461 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c9c02-3888-4d21-a9c1-ac5a9915a265 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:23:59.926870 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c9c02-3888-4d21-a9c1-ac5a9915a265 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:23:59.927044 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c9c02-3888-4d21-a9c1-ac5a9915a265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:23:59.951814 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-f46c9c02-3888-4d21-a9c1-ac5a9915a265 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:23:59.955284 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-f46c9c02-3888-4d21-a9c1-ac5a9915a265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:23:59.968271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 540/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:23:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:24:00.311194 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6b8f7-97c1-4722-9464-599eeb1083b8 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:00.322604 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6b8f7-97c1-4722-9464-599eeb1083b8 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:00.326107 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0b123-aec3-4557-b49d-9d5660caf1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:00.326739 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0b123-aec3-4557-b49d-9d5660caf1cb service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:00.327015 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0b123-aec3-4557-b49d-9d5660caf1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:00.327278 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0b123-aec3-4557-b49d-9d5660caf1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:00.338598 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0b123-aec3-4557-b49d-9d5660caf1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:00.340049 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0b123-aec3-4557-b49d-9d5660caf1cb service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:00.354968 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 520/1060] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:24:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:24:02.697847 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef834a9a-d134-4018-b29e-985199261b0d None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:02.698397 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef834a9a-d134-4018-b29e-985199261b0d None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:02.698397 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef834a9a-d134-4018-b29e-985199261b0d None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:02.699764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 541/1061] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:24:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:02.704990 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7a37c-4519-44f7-8307-65ebcff25e61 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:02.705396 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7a37c-4519-44f7-8307-65ebcff25e61 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:02.705559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7a37c-4519-44f7-8307-65ebcff25e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:02.724254 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-41f7a37c-4519-44f7-8307-65ebcff25e61 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:02.725443 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-41f7a37c-4519-44f7-8307-65ebcff25e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:02.733486 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 521/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:24:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:24:03.074430 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef834a9a-d134-4018-b29e-985199261b0d None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:03.084980 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef834a9a-d134-4018-b29e-985199261b0d None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:03.089199 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880be48-d087-444c-835e-ca422d77156a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:03.089779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880be48-d087-444c-835e-ca422d77156a service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:03.090050 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880be48-d087-444c-835e-ca422d77156a service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:03.090315 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880be48-d087-444c-835e-ca422d77156a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:03.098955 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880be48-d087-444c-835e-ca422d77156a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:03.100375 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880be48-d087-444c-835e-ca422d77156a service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:03.109660 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 542/1063] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:24:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:24:05.656317 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830632cd-7e85-4375-9846-840c9387f585 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:05.656870 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830632cd-7e85-4375-9846-840c9387f585 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:05.656870 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830632cd-7e85-4375-9846-840c9387f585 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:05.658284 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 522/1064] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:05.663677 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002aa64-054c-4a73-ac40-9e08afad7a12 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:05.664078 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002aa64-054c-4a73-ac40-9e08afad7a12 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:05.664230 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002aa64-054c-4a73-ac40-9e08afad7a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:05.683915 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-f002aa64-054c-4a73-ac40-9e08afad7a12 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:05.685120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-f002aa64-054c-4a73-ac40-9e08afad7a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:05.693300 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 543/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:24:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:24:06.068239 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830632cd-7e85-4375-9846-840c9387f585 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:06.079574 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830632cd-7e85-4375-9846-840c9387f585 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:06.083122 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fd6d0-45fa-4df2-a49c-7d3ade7858de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:06.083712 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fd6d0-45fa-4df2-a49c-7d3ade7858de service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:06.083989 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fd6d0-45fa-4df2-a49c-7d3ade7858de service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:06.084286 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fd6d0-45fa-4df2-a49c-7d3ade7858de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:06.093861 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fd6d0-45fa-4df2-a49c-7d3ade7858de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:06.095343 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fd6d0-45fa-4df2-a49c-7d3ade7858de service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:06.106923 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 523/1066] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:24:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:24:08.428340 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa810f8-24eb-41e2-806a-314320226ca4 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:08.428908 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa810f8-24eb-41e2-806a-314320226ca4 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:08.428908 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa810f8-24eb-41e2-806a-314320226ca4 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:08.430232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 544/1067] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:08.436019 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e521f-32d4-48db-91a7-7030787eb713 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:08.436457 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e521f-32d4-48db-91a7-7030787eb713 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:08.436553 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e521f-32d4-48db-91a7-7030787eb713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:08.456053 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-d60e521f-32d4-48db-91a7-7030787eb713 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:08.457246 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d60e521f-32d4-48db-91a7-7030787eb713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:08.464970 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 524/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:24:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:24:08.804845 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa810f8-24eb-41e2-806a-314320226ca4 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:08.816522 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa810f8-24eb-41e2-806a-314320226ca4 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:08.819965 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8bc8d-07a7-4424-8af5-0fb694e4c387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:08.820552 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8bc8d-07a7-4424-8af5-0fb694e4c387 service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:08.820826 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8bc8d-07a7-4424-8af5-0fb694e4c387 service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:08.821174 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8bc8d-07a7-4424-8af5-0fb694e4c387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:08.829838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8bc8d-07a7-4424-8af5-0fb694e4c387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:08.831322 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8bc8d-07a7-4424-8af5-0fb694e4c387 service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:08.840966 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 545/1069] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:24:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:24:11.068934 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea4afd-b3d7-4fdc-ac66-6b785ff9a459 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:11.069483 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea4afd-b3d7-4fdc-ac66-6b785ff9a459 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:11.069483 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea4afd-b3d7-4fdc-ac66-6b785ff9a459 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:11.070915 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 525/1070] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:11.076793 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395b27d-c262-4275-963e-163a4d659f68 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:11.077219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395b27d-c262-4275-963e-163a4d659f68 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:11.077332 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395b27d-c262-4275-963e-163a4d659f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:11.096796 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-a395b27d-c262-4275-963e-163a4d659f68 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:11.098008 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-a395b27d-c262-4275-963e-163a4d659f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:11.105887 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 546/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:24:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:24:11.448991 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea4afd-b3d7-4fdc-ac66-6b785ff9a459 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:11.459903 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea4afd-b3d7-4fdc-ac66-6b785ff9a459 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:11.464177 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c175c-8e98-4cf2-8ae1-e02784c5db64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:11.464786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c175c-8e98-4cf2-8ae1-e02784c5db64 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:11.465063 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c175c-8e98-4cf2-8ae1-e02784c5db64 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:11.465335 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c175c-8e98-4cf2-8ae1-e02784c5db64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:11.474584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c175c-8e98-4cf2-8ae1-e02784c5db64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:11.478913 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c175c-8e98-4cf2-8ae1-e02784c5db64 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:11.489418 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 526/1072] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:24:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:24:13.745143 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aef74-8c84-4a6d-ab20-837f2a769323 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:13.745709 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aef74-8c84-4a6d-ab20-837f2a769323 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:13.745709 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aef74-8c84-4a6d-ab20-837f2a769323 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:13.747193 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 547/1073] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:24:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:13.752345 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064e4e6-ff9a-4dea-a93d-c7b966e7f584 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:13.756442 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064e4e6-ff9a-4dea-a93d-c7b966e7f584 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:13.756442 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064e4e6-ff9a-4dea-a93d-c7b966e7f584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:13.772171 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-1064e4e6-ff9a-4dea-a93d-c7b966e7f584 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:13.773360 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-1064e4e6-ff9a-4dea-a93d-c7b966e7f584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:13.781574 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 527/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:24:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:24:14.127855 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aef74-8c84-4a6d-ab20-837f2a769323 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:14.139007 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aef74-8c84-4a6d-ab20-837f2a769323 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:14.142441 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963add7-4f2f-475a-93f4-2acd9c4548da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:14.143064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963add7-4f2f-475a-93f4-2acd9c4548da service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:14.143339 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963add7-4f2f-475a-93f4-2acd9c4548da service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:14.143607 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963add7-4f2f-475a-93f4-2acd9c4548da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:14.152702 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963add7-4f2f-475a-93f4-2acd9c4548da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:14.154157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963add7-4f2f-475a-93f4-2acd9c4548da service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:14.163344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 548/1075] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:24:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:24:16.460966 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df329725-1e53-4973-81a0-e11a9cf8edfc None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:16.461526 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df329725-1e53-4973-81a0-e11a9cf8edfc None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:16.461526 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df329725-1e53-4973-81a0-e11a9cf8edfc None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:16.462923 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 528/1076] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:16.468337 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a0172-6eac-4f2a-af96-a95c37d80c43 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:16.468761 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a0172-6eac-4f2a-af96-a95c37d80c43 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:16.468941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a0172-6eac-4f2a-af96-a95c37d80c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:16.476371 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=70 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:16.489249 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-6c8a0172-6eac-4f2a-af96-a95c37d80c43 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:16.490487 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-6c8a0172-6eac-4f2a-af96-a95c37d80c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:16.499393 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 549/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:24:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:24:16.848972 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df329725-1e53-4973-81a0-e11a9cf8edfc None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:16.854740 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=73 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:16.860321 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df329725-1e53-4973-81a0-e11a9cf8edfc None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:16.863736 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901079a-30c6-402b-8157-ceffd44b5b17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:16.864324 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901079a-30c6-402b-8157-ceffd44b5b17 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:16.868287 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901079a-30c6-402b-8157-ceffd44b5b17 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:16.868287 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901079a-30c6-402b-8157-ceffd44b5b17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:16.874713 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901079a-30c6-402b-8157-ceffd44b5b17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:16.876146 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901079a-30c6-402b-8157-ceffd44b5b17 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:16.886647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 529/1078] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:24:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:24:19.116247 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db39ec-095b-4c89-9434-7b4c39406d9b None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:19.116819 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db39ec-095b-4c89-9434-7b4c39406d9b None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:19.116819 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db39ec-095b-4c89-9434-7b4c39406d9b None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:19.118895 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 550/1079] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:24:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:19.124035 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb758a-cae7-476b-bf27-a3babc1be1e1 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:19.124479 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb758a-cae7-476b-bf27-a3babc1be1e1 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:19.124594 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb758a-cae7-476b-bf27-a3babc1be1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:19.145148 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c7fb758a-cae7-476b-bf27-a3babc1be1e1 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:19.146354 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c7fb758a-cae7-476b-bf27-a3babc1be1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:19.154135 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 530/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:24:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:24:19.491866 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db39ec-095b-4c89-9434-7b4c39406d9b None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:19.503354 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db39ec-095b-4c89-9434-7b4c39406d9b None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:19.506863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fce065-7e4f-42d4-acab-038fe736f20d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:19.507455 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fce065-7e4f-42d4-acab-038fe736f20d service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:19.507723 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fce065-7e4f-42d4-acab-038fe736f20d service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:19.507987 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fce065-7e4f-42d4-acab-038fe736f20d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:19.516814 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fce065-7e4f-42d4-acab-038fe736f20d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:19.518234 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fce065-7e4f-42d4-acab-038fe736f20d service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:19.527614 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 551/1081] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:24:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:24:21.735306 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7861233-3f5a-4cc3-935b-f47d8cbb989b None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:21.735883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7861233-3f5a-4cc3-935b-f47d8cbb989b None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:21.735883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7861233-3f5a-4cc3-935b-f47d8cbb989b None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:21.737283 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 531/1082] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:21.744161 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54ba0e-0ec5-4619-9728-9032127bf3a9 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:21.744592 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54ba0e-0ec5-4619-9728-9032127bf3a9 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:21.744711 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54ba0e-0ec5-4619-9728-9032127bf3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:21.763710 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-0c54ba0e-0ec5-4619-9728-9032127bf3a9 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:21.764915 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-0c54ba0e-0ec5-4619-9728-9032127bf3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:21.772648 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 552/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:24:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:24:22.116013 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7861233-3f5a-4cc3-935b-f47d8cbb989b None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:22.126827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7861233-3f5a-4cc3-935b-f47d8cbb989b None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:22.130228 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cd123-051f-4b2b-8b33-f9e7d6cbb04f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:22.130847 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cd123-051f-4b2b-8b33-f9e7d6cbb04f service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:22.131120 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cd123-051f-4b2b-8b33-f9e7d6cbb04f service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:22.131384 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cd123-051f-4b2b-8b33-f9e7d6cbb04f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:22.139937 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cd123-051f-4b2b-8b33-f9e7d6cbb04f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:22.141360 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cd123-051f-4b2b-8b33-f9e7d6cbb04f service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:22.151176 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 532/1084] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:24:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:24:24.370402 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca22a6-2c27-469c-8a1c-4cd790f385bb None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:24.371039 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca22a6-2c27-469c-8a1c-4cd790f385bb None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:24.371039 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca22a6-2c27-469c-8a1c-4cd790f385bb None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:24.372322 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 553/1085] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:24.377588 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086ea36-ba03-4075-abe4-22f0207e0fa8 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:24.377993 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086ea36-ba03-4075-abe4-22f0207e0fa8 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:24.378123 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086ea36-ba03-4075-abe4-22f0207e0fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:24.397641 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-b086ea36-ba03-4075-abe4-22f0207e0fa8 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:24.399021 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-b086ea36-ba03-4075-abe4-22f0207e0fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:24.406733 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 533/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:24:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:24:24.747866 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca22a6-2c27-469c-8a1c-4cd790f385bb None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:24.758959 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca22a6-2c27-469c-8a1c-4cd790f385bb None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:24.762416 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dfa35-7093-42bf-bcd2-c22f728ed049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:24.763042 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dfa35-7093-42bf-bcd2-c22f728ed049 service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:24.763315 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dfa35-7093-42bf-bcd2-c22f728ed049 service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:24.763580 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dfa35-7093-42bf-bcd2-c22f728ed049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:24.772223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dfa35-7093-42bf-bcd2-c22f728ed049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:24.773685 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dfa35-7093-42bf-bcd2-c22f728ed049 service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:24.782974 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 554/1087] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:24:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:24:34.392974 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=17 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:34.778865 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=17 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:24:48.952410 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ece7b-d328-484e-9c2b-347c2015ba54 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:48.952993 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ece7b-d328-484e-9c2b-347c2015ba54 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:48.952993 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ece7b-d328-484e-9c2b-347c2015ba54 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:48.954194 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 534/1088] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:48.959483 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d90cb-527b-41ad-9b51-163e213baeff None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:48.959913 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d90cb-527b-41ad-9b51-163e213baeff None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:48.960071 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d90cb-527b-41ad-9b51-163e213baeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:48.979030 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-c14d90cb-527b-41ad-9b51-163e213baeff None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:48.980233 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-c14d90cb-527b-41ad-9b51-163e213baeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:48.987964 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 555/1089] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:24:49.349647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79ad76-36f8-4c3c-a693-7a5c34f7d379 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:49.349929 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79ad76-36f8-4c3c-a693-7a5c34f7d379 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:49.350199 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79ad76-36f8-4c3c-a693-7a5c34f7d379 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:49.351815 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 535/1090] 10.222.0.61 () {54 vars in 967 bytes} [Fri Aug 19 19:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:49.356931 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677cc17-f043-47f2-a40c-ccac5997b9fc None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:49.357226 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677cc17-f043-47f2-a40c-ccac5997b9fc None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:49.357502 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677cc17-f043-47f2-a40c-ccac5997b9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:49.376865 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-9677cc17-f043-47f2-a40c-ccac5997b9fc None None] MFA Rules not processed for user `1bca70a332304359bcc9d873ebbe14de`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:49.378066 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-9677cc17-f043-47f2-a40c-ccac5997b9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:49.385587 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 556/1091] 10.222.0.61 () {58 vars in 1064 bytes} [Fri Aug 19 19:24:49 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:24:49.392869 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79ad76-36f8-4c3c-a693-7a5c34f7d379 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:49.404026 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79ad76-36f8-4c3c-a693-7a5c34f7d379 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:49.407490 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ac887-3c6a-48f1-857a-1d98f3874c18 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bca70a332304359bcc9d873ebbe14de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:49.408070 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ac887-3c6a-48f1-857a-1d98f3874c18 service glance] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:49.408344 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ac887-3c6a-48f1-857a-1d98f3874c18 service glance] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:49.408610 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ac887-3c6a-48f1-857a-1d98f3874c18 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:49.417605 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ac887-3c6a-48f1-857a-1d98f3874c18 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:49.419087 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ac887-3c6a-48f1-857a-1d98f3874c18 service glance] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:49.428564 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 536/1092] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:24:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:24:51.707803 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ae1b5-4e05-4442-ba0a-f3b043850e09 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:51.708359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ae1b5-4e05-4442-ba0a-f3b043850e09 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:51.708359 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ae1b5-4e05-4442-ba0a-f3b043850e09 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:51.709718 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 557/1093] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:51.714992 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c5075-6276-47f9-aec8-a5835e3ec508 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:51.715425 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c5075-6276-47f9-aec8-a5835e3ec508 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:51.715535 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c5075-6276-47f9-aec8-a5835e3ec508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:51.734620 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-df7c5075-6276-47f9-aec8-a5835e3ec508 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:51.735835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-df7c5075-6276-47f9-aec8-a5835e3ec508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:51.744147 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 537/1094] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:24:52.079656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ae1b5-4e05-4442-ba0a-f3b043850e09 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:52.092771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ae1b5-4e05-4442-ba0a-f3b043850e09 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:52.097328 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b45741-3663-4f1c-bc6c-420b5bbb497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:52.097920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b45741-3663-4f1c-bc6c-420b5bbb497e admin admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:52.098198 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b45741-3663-4f1c-bc6c-420b5bbb497e admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:52.098468 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b45741-3663-4f1c-bc6c-420b5bbb497e admin admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:52.099129 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b45741-3663-4f1c-bc6c-420b5bbb497e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:52.101653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: WARNING py.warnings [None req-19b45741-3663-4f1c-bc6c-420b5bbb497e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:24:52.101653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: warnings.warn(msg) Aug 19 19:24:52.101653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: Aug 19 19:24:52.102837 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b45741-3663-4f1c-bc6c-420b5bbb497e admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:52.121224 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 558/1095] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Aug 19 19:24:52 2022] GET /identity/v3/projects => generated 1606 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 19:24:54.325880 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963effb-bb0c-4249-a5a3-16da312d1bd4 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:54.326551 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963effb-bb0c-4249-a5a3-16da312d1bd4 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:54.326551 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963effb-bb0c-4249-a5a3-16da312d1bd4 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:54.327809 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 538/1096] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:54.333051 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383461e-1bd7-4b5a-afd0-b75977e7c45e None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:54.333477 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383461e-1bd7-4b5a-afd0-b75977e7c45e None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:54.333601 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383461e-1bd7-4b5a-afd0-b75977e7c45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:54.352990 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-1383461e-1bd7-4b5a-afd0-b75977e7c45e None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:54.354199 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-1383461e-1bd7-4b5a-afd0-b75977e7c45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:54.361862 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 559/1097] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:24:54.708851 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963effb-bb0c-4249-a5a3-16da312d1bd4 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:54.722321 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963effb-bb0c-4249-a5a3-16da312d1bd4 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:54.727969 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13d239-3699-4366-8cb2-8a8774597aff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:54.728559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13d239-3699-4366-8cb2-8a8774597aff service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:54.728837 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13d239-3699-4366-8cb2-8a8774597aff service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:54.729105 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13d239-3699-4366-8cb2-8a8774597aff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:54.737200 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13d239-3699-4366-8cb2-8a8774597aff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:54.738845 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13d239-3699-4366-8cb2-8a8774597aff service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:54.748930 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 539/1098] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:24:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:24:57.189222 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa65dae-5e23-4576-8592-a3924148a9d2 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:57.190043 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa65dae-5e23-4576-8592-a3924148a9d2 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:57.190043 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa65dae-5e23-4576-8592-a3924148a9d2 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:57.191407 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 560/1099] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:57.197115 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762470eb-5e31-4238-88c6-fd5aaeaefdf2 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:57.197549 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762470eb-5e31-4238-88c6-fd5aaeaefdf2 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:57.197660 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762470eb-5e31-4238-88c6-fd5aaeaefdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:57.217438 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-762470eb-5e31-4238-88c6-fd5aaeaefdf2 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:57.218588 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-762470eb-5e31-4238-88c6-fd5aaeaefdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:57.226951 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 540/1100] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:24:57.568125 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa65dae-5e23-4576-8592-a3924148a9d2 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:24:57.579611 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa65dae-5e23-4576-8592-a3924148a9d2 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:24:57.583238 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb117a6-1fdd-4891-9fd3-861c0d23a2f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:24:57.583828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb117a6-1fdd-4891-9fd3-861c0d23a2f5 service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:57.584099 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb117a6-1fdd-4891-9fd3-861c0d23a2f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:57.584366 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb117a6-1fdd-4891-9fd3-861c0d23a2f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:57.593977 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb117a6-1fdd-4891-9fd3-861c0d23a2f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:24:57.595471 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb117a6-1fdd-4891-9fd3-861c0d23a2f5 service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:24:57.604913 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 561/1101] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:24:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:24:59.846488 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596eab5-fbb2-425d-b5dd-5a0d5bc65c29 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:59.847055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596eab5-fbb2-425d-b5dd-5a0d5bc65c29 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:59.847055 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596eab5-fbb2-425d-b5dd-5a0d5bc65c29 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:59.848340 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 541/1102] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:24:59.854397 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23ad25-2715-452a-8095-38b155bda2b7 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:24:59.854832 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23ad25-2715-452a-8095-38b155bda2b7 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:24:59.854971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23ad25-2715-452a-8095-38b155bda2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:24:59.874033 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-8d23ad25-2715-452a-8095-38b155bda2b7 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:24:59.875256 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-8d23ad25-2715-452a-8095-38b155bda2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:24:59.883090 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 562/1103] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:24:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:25:00.227082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596eab5-fbb2-425d-b5dd-5a0d5bc65c29 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:25:00.237678 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596eab5-fbb2-425d-b5dd-5a0d5bc65c29 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:25:00.241857 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942ce0a-d730-4baa-9872-3c848ca3346a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:25:00.242244 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942ce0a-d730-4baa-9872-3c848ca3346a service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:00.242493 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942ce0a-d730-4baa-9872-3c848ca3346a service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:00.242792 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942ce0a-d730-4baa-9872-3c848ca3346a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:00.251836 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942ce0a-d730-4baa-9872-3c848ca3346a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:25:00.253280 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942ce0a-d730-4baa-9872-3c848ca3346a service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:25:00.263428 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 542/1104] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:25:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:25:02.546930 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6d0d7-eecb-4a17-9616-e3e25306aa67 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:02.547492 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6d0d7-eecb-4a17-9616-e3e25306aa67 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:02.547492 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6d0d7-eecb-4a17-9616-e3e25306aa67 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:02.548860 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 563/1105] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:25:02.555083 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f66b7-8075-4a69-8099-c217db2bd167 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:02.555504 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f66b7-8075-4a69-8099-c217db2bd167 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:02.570258 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f66b7-8075-4a69-8099-c217db2bd167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:02.576078 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-a08f66b7-8075-4a69-8099-c217db2bd167 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:25:02.577041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-a08f66b7-8075-4a69-8099-c217db2bd167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:25:02.584819 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 543/1106] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:25:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:25:02.943501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6d0d7-eecb-4a17-9616-e3e25306aa67 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:25:02.954680 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6d0d7-eecb-4a17-9616-e3e25306aa67 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:25:02.958171 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd666bd-dd9f-4de1-9ff7-8c07980dddf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:25:02.958792 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd666bd-dd9f-4de1-9ff7-8c07980dddf0 service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:02.959070 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd666bd-dd9f-4de1-9ff7-8c07980dddf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:02.959340 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd666bd-dd9f-4de1-9ff7-8c07980dddf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:02.968766 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd666bd-dd9f-4de1-9ff7-8c07980dddf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:25:02.970194 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd666bd-dd9f-4de1-9ff7-8c07980dddf0 service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:25:02.979647 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 564/1107] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:25:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:25:05.613943 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8852d-abd9-47f6-afc9-23d630f21ecd None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:05.614450 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8852d-abd9-47f6-afc9-23d630f21ecd None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:05.614572 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8852d-abd9-47f6-afc9-23d630f21ecd None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:05.616468 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 544/1108] 10.222.0.61 () {54 vars in 927 bytes} [Fri Aug 19 19:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:25:05.621756 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014a9c3-12ba-4491-acd8-119d16f941c2 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:05.622219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014a9c3-12ba-4491-acd8-119d16f941c2 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:05.622325 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014a9c3-12ba-4491-acd8-119d16f941c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:05.641940 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-b014a9c3-12ba-4491-acd8-119d16f941c2 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:25:05.643151 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-b014a9c3-12ba-4491-acd8-119d16f941c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:25:05.651271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 565/1109] 10.222.0.61 () {58 vars in 1024 bytes} [Fri Aug 19 19:25:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:25:05.999476 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8852d-abd9-47f6-afc9-23d630f21ecd None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:25:06.010640 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8852d-abd9-47f6-afc9-23d630f21ecd None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:25:06.014185 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2ad3a-837b-4c25-b433-ce3f1bea8bef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:25:06.014803 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2ad3a-837b-4c25-b433-ce3f1bea8bef service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:25:06.015081 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2ad3a-837b-4c25-b433-ce3f1bea8bef service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:25:06.015353 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2ad3a-837b-4c25-b433-ce3f1bea8bef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:25:06.025139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2ad3a-837b-4c25-b433-ce3f1bea8bef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:25:06.026594 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2ad3a-837b-4c25-b433-ce3f1bea8bef service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:25:06.035945 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 545/1110] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:25:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:25:15.637201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=33 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:25:16.031847 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=33 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:29.102323 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c1259-85e5-4acc-b99a-012737b80109 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:29.102992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c1259-85e5-4acc-b99a-012737b80109 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:29.102992 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c1259-85e5-4acc-b99a-012737b80109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:29.122923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-232c1259-85e5-4acc-b99a-012737b80109 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:26:29.124715 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-232c1259-85e5-4acc-b99a-012737b80109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:26:29.132490 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 566/1111] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:26:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:26:29.140409 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3418c91-a48d-4691-85cd-efd9013850b9 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:29.140938 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3418c91-a48d-4691-85cd-efd9013850b9 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:29.140938 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3418c91-a48d-4691-85cd-efd9013850b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:29.160090 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-e3418c91-a48d-4691-85cd-efd9013850b9 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:26:29.161289 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e3418c91-a48d-4691-85cd-efd9013850b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:26:29.169586 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 546/1112] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:26:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:26:29.173962 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c1259-85e5-4acc-b99a-012737b80109 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:29.183528 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c1259-85e5-4acc-b99a-012737b80109 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:29.187993 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd37c31-f4a9-4465-990b-8538e4eaac9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:29.188576 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd37c31-f4a9-4465-990b-8538e4eaac9e admin admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:29.188852 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd37c31-f4a9-4465-990b-8538e4eaac9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:29.189120 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd37c31-f4a9-4465-990b-8538e4eaac9e admin admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:29.189746 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd37c31-f4a9-4465-990b-8538e4eaac9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:26:29.190071 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd37c31-f4a9-4465-990b-8538e4eaac9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:29.191357 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: WARNING py.warnings [None req-3fd37c31-f4a9-4465-990b-8538e4eaac9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:26:29.191357 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: warnings.warn(msg) Aug 19 19:26:29.191357 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: Aug 19 19:26:29.192232 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd37c31-f4a9-4465-990b-8538e4eaac9e admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:29.203440 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 567/1113] 10.222.0.61 () {58 vars in 1153 bytes} [Fri Aug 19 19:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:26:29.211370 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3418c91-a48d-4691-85cd-efd9013850b9 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:29.221154 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3418c91-a48d-4691-85cd-efd9013850b9 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:29.225741 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f3185-e531-4b97-a381-b201589dd3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:29.226334 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f3185-e531-4b97-a381-b201589dd3ed admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:29.226642 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f3185-e531-4b97-a381-b201589dd3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:29.226914 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f3185-e531-4b97-a381-b201589dd3ed admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:29.227538 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f3185-e531-4b97-a381-b201589dd3ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:29.229987 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: WARNING py.warnings [None req-a88f3185-e531-4b97-a381-b201589dd3ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:26:29.229987 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: warnings.warn(msg) Aug 19 19:26:29.229987 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: Aug 19 19:26:29.231210 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f3185-e531-4b97-a381-b201589dd3ed admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:29.343030 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 547/1114] 10.222.0.61 () {60 vars in 1153 bytes} [Fri Aug 19 19:26:29 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:26:29.347307 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd37c31-f4a9-4465-990b-8538e4eaac9e admin admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:29.358796 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd37c31-f4a9-4465-990b-8538e4eaac9e admin admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:29.415785 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab48e6-2045-46cd-b17d-74e1bb00019d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:29.416516 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab48e6-2045-46cd-b17d-74e1bb00019d admin admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:29.416794 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab48e6-2045-46cd-b17d-74e1bb00019d admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:29.417081 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab48e6-2045-46cd-b17d-74e1bb00019d admin admin] PATH_INFO: `/v3/users` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:29.417695 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab48e6-2045-46cd-b17d-74e1bb00019d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:29.418735 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: WARNING py.warnings [None req-07ab48e6-2045-46cd-b17d-74e1bb00019d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:26:29.418735 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: warnings.warn(msg) Aug 19 19:26:29.418735 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: Aug 19 19:26:29.419944 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab48e6-2045-46cd-b17d-74e1bb00019d admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:29.478270 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 568/1115] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Aug 19 19:26:29 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:26:29.482650 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f3185-e531-4b97-a381-b201589dd3ed admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:29.493001 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f3185-e531-4b97-a381-b201589dd3ed admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:29.497638 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99d79b-66ad-4989-82cc-91cc416a3c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:29.500497 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99d79b-66ad-4989-82cc-91cc416a3c0b admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:29.500497 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99d79b-66ad-4989-82cc-91cc416a3c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:29.500497 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99d79b-66ad-4989-82cc-91cc416a3c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:29.500497 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99d79b-66ad-4989-82cc-91cc416a3c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:29.500497 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: WARNING py.warnings [None req-8e99d79b-66ad-4989-82cc-91cc416a3c0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:26:29.500497 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: warnings.warn(msg) Aug 19 19:26:29.500497 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: Aug 19 19:26:29.501271 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99d79b-66ad-4989-82cc-91cc416a3c0b admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:29.514543 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 548/1116] 10.222.0.61 () {58 vars in 1122 bytes} [Fri Aug 19 19:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:26:29.518671 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab48e6-2045-46cd-b17d-74e1bb00019d admin admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:29.529292 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab48e6-2045-46cd-b17d-74e1bb00019d admin admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:29.533863 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6584b5b-87a4-4c5a-91d2-0495a2151404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:29.534447 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6584b5b-87a4-4c5a-91d2-0495a2151404 admin admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:29.534756 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6584b5b-87a4-4c5a-91d2-0495a2151404 admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:29.535029 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6584b5b-87a4-4c5a-91d2-0495a2151404 admin admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:29.535663 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6584b5b-87a4-4c5a-91d2-0495a2151404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:29.536654 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: WARNING py.warnings [None req-d6584b5b-87a4-4c5a-91d2-0495a2151404 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:26:29.536654 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: warnings.warn(msg) Aug 19 19:26:29.536654 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: Aug 19 19:26:29.537541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6584b5b-87a4-4c5a-91d2-0495a2151404 admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:29.551128 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 569/1117] 10.222.0.61 () {58 vars in 1122 bytes} [Fri Aug 19 19:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:26:29.555208 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99d79b-66ad-4989-82cc-91cc416a3c0b admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:29.565235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99d79b-66ad-4989-82cc-91cc416a3c0b admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:29.570120 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202693c-bf8e-40f8-98f4-858c96bb5a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:29.570803 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202693c-bf8e-40f8-98f4-858c96bb5a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:29.571105 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202693c-bf8e-40f8-98f4-858c96bb5a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:29.571359 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202693c-bf8e-40f8-98f4-858c96bb5a14 admin admin] PATH_INFO: `/v3/projects/b44a5756706c4e40b57326a94bd6b2fc/users/f8fc2fcfbeb247528bc6190d9ecc6029/roles/83a904d35afc48fe9f8d55c0fd1597d8` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:29.587149 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202693c-bf8e-40f8-98f4-858c96bb5a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44a5756706c4e40b57326a94bd6b2fc, user_id=f8fc2fcfbeb247528bc6190d9ecc6029, role_id=83a904d35afc48fe9f8d55c0fd1597d8)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:29.589093 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: WARNING py.warnings [None req-7202693c-bf8e-40f8-98f4-858c96bb5a14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:26:29.589093 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: warnings.warn(msg) Aug 19 19:26:29.589093 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: Aug 19 19:26:29.591077 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202693c-bf8e-40f8-98f4-858c96bb5a14 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:29.660985 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 549/1118] 10.222.0.61 () {60 vars in 1483 bytes} [Fri Aug 19 19:26:29 2022] PUT /identity/v3/projects/b44a5756706c4e40b57326a94bd6b2fc/users/f8fc2fcfbeb247528bc6190d9ecc6029/roles/83a904d35afc48fe9f8d55c0fd1597d8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:26:29.673106 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5d3d2-a458-4bc7-a512-6e5d482af5bd None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:29.673389 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5d3d2-a458-4bc7-a512-6e5d482af5bd None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:29.673659 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5d3d2-a458-4bc7-a512-6e5d482af5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:29.702245 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-1be5d3d2-a458-4bc7-a512-6e5d482af5bd None None] MFA Rules not processed for user `f8fc2fcfbeb247528bc6190d9ecc6029`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:26:29.703489 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-1be5d3d2-a458-4bc7-a512-6e5d482af5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:26:29.765894 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 570/1119] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:26:29 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:26:29.779067 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96552616-16f6-4faf-802c-f425e6d9a652 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:29.779351 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96552616-16f6-4faf-802c-f425e6d9a652 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:29.779628 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96552616-16f6-4faf-802c-f425e6d9a652 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:29.780944 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 550/1120] 10.222.0.61 () {54 vars in 964 bytes} [Fri Aug 19 19:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:26:29.785712 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba7a7a-c18a-43ce-8e15-b109a0c56051 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:29.786000 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba7a7a-c18a-43ce-8e15-b109a0c56051 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:29.786278 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba7a7a-c18a-43ce-8e15-b109a0c56051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:29.805234 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-8dba7a7a-c18a-43ce-8e15-b109a0c56051 None None] MFA Rules not processed for user `23bbd8bfe6924ea2a6fd35513f830cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:26:29.806963 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-8dba7a7a-c18a-43ce-8e15-b109a0c56051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:26:29.849539 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:29.856821 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 571/1121] 10.222.0.61 () {58 vars in 1061 bytes} [Fri Aug 19 19:26:29 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:26:29.864511 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96552616-16f6-4faf-802c-f425e6d9a652 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:29.875638 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96552616-16f6-4faf-802c-f425e6d9a652 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:29.879083 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787ddf4-d36f-45d2-8f64-3404e99172b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23bbd8bfe6924ea2a6fd35513f830cb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:29.879659 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787ddf4-d36f-45d2-8f64-3404e99172b4 service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:29.879930 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787ddf4-d36f-45d2-8f64-3404e99172b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:29.880194 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787ddf4-d36f-45d2-8f64-3404e99172b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:29.888969 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787ddf4-d36f-45d2-8f64-3404e99172b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:29.890383 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787ddf4-d36f-45d2-8f64-3404e99172b4 service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:29.901546 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 551/1122] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:26:29 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:26:29.942127 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8c7f3-34b8-45f6-859f-23d2750dca17 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:29.942415 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8c7f3-34b8-45f6-859f-23d2750dca17 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:29.942723 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8c7f3-34b8-45f6-859f-23d2750dca17 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:29.943993 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 572/1123] 10.222.0.61 () {52 vars in 830 bytes} [Fri Aug 19 19:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:26:29.948105 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787ddf4-d36f-45d2-8f64-3404e99172b4 service cinder] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:30.009132 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787ddf4-d36f-45d2-8f64-3404e99172b4 service cinder] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:30.014327 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fa12d-81a5-4159-a1d9-df94cfb2c28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:30.019999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fa12d-81a5-4159-a1d9-df94cfb2c28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:30.019999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fa12d-81a5-4159-a1d9-df94cfb2c28e admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:30.019999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fa12d-81a5-4159-a1d9-df94cfb2c28e admin admin] PATH_INFO: `/v3/users/f8fc2fcfbeb247528bc6190d9ecc6029` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:30.019999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fa12d-81a5-4159-a1d9-df94cfb2c28e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8fc2fcfbeb247528bc6190d9ecc6029)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:30.019999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: WARNING py.warnings [None req-e88fa12d-81a5-4159-a1d9-df94cfb2c28e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:26:30.019999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: warnings.warn(msg) Aug 19 19:26:30.019999 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: Aug 19 19:26:30.020552 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fa12d-81a5-4159-a1d9-df94cfb2c28e admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:30.283564 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e88fa12d-81a5-4159-a1d9-df94cfb2c28e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8fc2fcfbeb247528bc6190d9ecc6029'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:26:30.404495 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e88fa12d-81a5-4159-a1d9-df94cfb2c28e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8fc2fcfbeb247528bc6190d9ecc6029'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:26:30.428953 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e88fa12d-81a5-4159-a1d9-df94cfb2c28e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8fc2fcfbeb247528bc6190d9ecc6029'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:26:30.429640 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e88fa12d-81a5-4159-a1d9-df94cfb2c28e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8fc2fcfbeb247528bc6190d9ecc6029'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:26:30.430351 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-e88fa12d-81a5-4159-a1d9-df94cfb2c28e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8fc2fcfbeb247528bc6190d9ecc6029'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:26:30.441735 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:30.451523 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 552/1124] 10.222.0.61 () {58 vars in 1224 bytes} [Fri Aug 19 19:26:29 2022] DELETE /identity/v3/users/f8fc2fcfbeb247528bc6190d9ecc6029 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:26:30.456026 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf448dd-b517-41f9-8630-d54548b5d6b6 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:30.456753 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf448dd-b517-41f9-8630-d54548b5d6b6 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:30.456753 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf448dd-b517-41f9-8630-d54548b5d6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:30.476197 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-fdf448dd-b517-41f9-8630-d54548b5d6b6 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:26:30.477455 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-fdf448dd-b517-41f9-8630-d54548b5d6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:26:30.538069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 573/1125] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:26:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:26:30.548110 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fa12d-81a5-4159-a1d9-df94cfb2c28e admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:30.549537 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-e88fa12d-81a5-4159-a1d9-df94cfb2c28e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:26:30.621394 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fa12d-81a5-4159-a1d9-df94cfb2c28e admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:30.624939 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782d73a-a0e1-4e83-9dd6-b109f63b61e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:30.625543 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782d73a-a0e1-4e83-9dd6-b109f63b61e6 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:30.625812 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782d73a-a0e1-4e83-9dd6-b109f63b61e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:30.626120 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782d73a-a0e1-4e83-9dd6-b109f63b61e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:30.635144 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782d73a-a0e1-4e83-9dd6-b109f63b61e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:30.636584 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782d73a-a0e1-4e83-9dd6-b109f63b61e6 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:30.646150 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 553/1126] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:26:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:26:31.131291 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf448dd-b517-41f9-8630-d54548b5d6b6 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:26:31.132700 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-fdf448dd-b517-41f9-8630-d54548b5d6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:26:31.149584 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf448dd-b517-41f9-8630-d54548b5d6b6 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:26:31.152303 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811df13f-ca91-4fec-9cd5-2344ef17b3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:26:31.152934 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811df13f-ca91-4fec-9cd5-2344ef17b3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:26:31.153208 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811df13f-ca91-4fec-9cd5-2344ef17b3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:26:31.153477 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811df13f-ca91-4fec-9cd5-2344ef17b3b4 admin admin] PATH_INFO: `/v3/projects/b44a5756706c4e40b57326a94bd6b2fc` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:26:31.154729 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811df13f-ca91-4fec-9cd5-2344ef17b3b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44a5756706c4e40b57326a94bd6b2fc)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:26:31.155779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: WARNING py.warnings [None req-811df13f-ca91-4fec-9cd5-2344ef17b3b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:26:31.155779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: warnings.warn(msg) Aug 19 19:26:31.155779 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: Aug 19 19:26:31.156987 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811df13f-ca91-4fec-9cd5-2344ef17b3b4 admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:26:31.277970 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-811df13f-ca91-4fec-9cd5-2344ef17b3b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44a5756706c4e40b57326a94bd6b2fc', 'request_id': 'req-811df13f-ca91-4fec-9cd5-2344ef17b3b4'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:26:31.375295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-811df13f-ca91-4fec-9cd5-2344ef17b3b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44a5756706c4e40b57326a94bd6b2fc', 'request_id': 'req-811df13f-ca91-4fec-9cd5-2344ef17b3b4'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:26:31.389280 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-811df13f-ca91-4fec-9cd5-2344ef17b3b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44a5756706c4e40b57326a94bd6b2fc', 'request_id': 'req-811df13f-ca91-4fec-9cd5-2344ef17b3b4'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:26:31.399971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-811df13f-ca91-4fec-9cd5-2344ef17b3b4 admin admin] The token cache is being invalidate because project b44a5756706c4e40b57326a94bd6b2fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 19:26:31.400264 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-811df13f-ca91-4fec-9cd5-2344ef17b3b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:26:31.401091 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-811df13f-ca91-4fec-9cd5-2344ef17b3b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:26:31.402647 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 574/1127] 10.222.0.61 () {58 vars in 1233 bytes} [Fri Aug 19 19:26:31 2022] DELETE /identity/v3/projects/b44a5756706c4e40b57326a94bd6b2fc => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:26:40.642041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=34 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:26:41.396933 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:27:56.571649 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33dab8-bdb2-4002-86eb-a3d1561a4017 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:27:56.572295 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33dab8-bdb2-4002-86eb-a3d1561a4017 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:27:56.572295 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33dab8-bdb2-4002-86eb-a3d1561a4017 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:27:56.573542 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 554/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:27:56.578629 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4a96d-04b9-4f0c-b2eb-64e1bebf7b8f None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:27:56.579024 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4a96d-04b9-4f0c-b2eb-64e1bebf7b8f None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:27:56.579178 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4a96d-04b9-4f0c-b2eb-64e1bebf7b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:27:56.601016 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-3dd4a96d-04b9-4f0c-b2eb-64e1bebf7b8f None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:27:56.602212 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-3dd4a96d-04b9-4f0c-b2eb-64e1bebf7b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:27:56.658731 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 575/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:27:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:27:56.816826 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33dab8-bdb2-4002-86eb-a3d1561a4017 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:27:56.818555 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4f33dab8-bdb2-4002-86eb-a3d1561a4017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:27:56.887846 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33dab8-bdb2-4002-86eb-a3d1561a4017 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:27:56.892686 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e42f2a-f305-4b8b-8d4a-4a21349e4519 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:27:56.893287 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e42f2a-f305-4b8b-8d4a-4a21349e4519 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:27:56.893748 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e42f2a-f305-4b8b-8d4a-4a21349e4519 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:27:56.894027 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e42f2a-f305-4b8b-8d4a-4a21349e4519 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:27:56.902174 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e42f2a-f305-4b8b-8d4a-4a21349e4519 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:27:56.903788 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e42f2a-f305-4b8b-8d4a-4a21349e4519 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:27:56.913789 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 555/1130] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:27:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:27:57.764541 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d8be-a89e-4846-a277-7604a787589f None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:27:57.765163 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d8be-a89e-4846-a277-7604a787589f None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:27:57.765163 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d8be-a89e-4846-a277-7604a787589f None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:27:57.766387 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 576/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:27:57.771290 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263c886-da26-4a59-8269-a7564aeccfe2 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:27:57.771714 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263c886-da26-4a59-8269-a7564aeccfe2 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:27:57.771821 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263c886-da26-4a59-8269-a7564aeccfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:27:57.791198 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c263c886-da26-4a59-8269-a7564aeccfe2 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:27:57.792386 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c263c886-da26-4a59-8269-a7564aeccfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:27:57.800747 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 556/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:27:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:27:57.956778 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d8be-a89e-4846-a277-7604a787589f None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:27:57.970466 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d8be-a89e-4846-a277-7604a787589f None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:27:57.976422 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ba9cc-2fef-48d3-864b-fde204258e84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:27:57.977017 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ba9cc-2fef-48d3-864b-fde204258e84 service nova] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:27:57.977293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ba9cc-2fef-48d3-864b-fde204258e84 service nova] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:27:57.977586 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ba9cc-2fef-48d3-864b-fde204258e84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:27:57.985918 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ba9cc-2fef-48d3-864b-fde204258e84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:27:57.988395 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ba9cc-2fef-48d3-864b-fde204258e84 service nova] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:27:57.998950 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 577/1133] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:27:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:02.874044 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd9748-3e11-4cce-b92e-4aa3a4c43233 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:02.874636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd9748-3e11-4cce-b92e-4aa3a4c43233 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:02.874636 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd9748-3e11-4cce-b92e-4aa3a4c43233 None None] PATH_INFO: `/v3` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:02.875840 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 557/1134] 10.222.0.15 () {54 vars in 925 bytes} [Fri Aug 19 19:28:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 19:28:02.881781 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805138f9-3915-4b7f-88f7-6fc9ed621dd1 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:02.882221 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805138f9-3915-4b7f-88f7-6fc9ed621dd1 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:02.882326 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805138f9-3915-4b7f-88f7-6fc9ed621dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:02.913682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-805138f9-3915-4b7f-88f7-6fc9ed621dd1 None None] MFA Rules not processed for user `4aab18dc39cf4d119ba5f07fda334ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:02.914963 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-805138f9-3915-4b7f-88f7-6fc9ed621dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:02.976454 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 578/1135] 10.222.0.15 () {58 vars in 1015 bytes} [Fri Aug 19 19:28:02 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:28:07.785916 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=35 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:28:09.276140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08994486-538f-46c5-b8f3-9dd610ffb79f None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:09.276804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08994486-538f-46c5-b8f3-9dd610ffb79f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:09.276804 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08994486-538f-46c5-b8f3-9dd610ffb79f None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:09.278025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 558/1136] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:09.282853 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84a73b-acc8-4f09-82fd-30aed0e0991b None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:09.283301 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84a73b-acc8-4f09-82fd-30aed0e0991b None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:09.283417 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84a73b-acc8-4f09-82fd-30aed0e0991b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:09.303131 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-7e84a73b-acc8-4f09-82fd-30aed0e0991b None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:09.304331 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-7e84a73b-acc8-4f09-82fd-30aed0e0991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:09.312278 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 579/1137] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:28:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:09.472745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08994486-538f-46c5-b8f3-9dd610ffb79f None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:09.486264 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08994486-538f-46c5-b8f3-9dd610ffb79f None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:09.491794 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf03cfd-3506-43e4-ae1b-3e4828564191 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:09.492392 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf03cfd-3506-43e4-ae1b-3e4828564191 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:09.492673 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf03cfd-3506-43e4-ae1b-3e4828564191 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:09.492941 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf03cfd-3506-43e4-ae1b-3e4828564191 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:09.501045 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf03cfd-3506-43e4-ae1b-3e4828564191 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:09.503251 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf03cfd-3506-43e4-ae1b-3e4828564191 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:09.512663 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 559/1138] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:10.349294 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e01b8-0c7b-4e47-bc82-490a2b76cd7b None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:10.349838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e01b8-0c7b-4e47-bc82-490a2b76cd7b None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:10.349838 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e01b8-0c7b-4e47-bc82-490a2b76cd7b None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:10.351201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 580/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:10.356038 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b76540-c8bc-4f8d-b31b-bceb219e9f77 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:10.356486 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b76540-c8bc-4f8d-b31b-bceb219e9f77 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:10.356597 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b76540-c8bc-4f8d-b31b-bceb219e9f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:10.376001 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-92b76540-c8bc-4f8d-b31b-bceb219e9f77 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:10.377904 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-92b76540-c8bc-4f8d-b31b-bceb219e9f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:10.385702 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 560/1140] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:28:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:10.541713 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e01b8-0c7b-4e47-bc82-490a2b76cd7b None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:10.555926 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e01b8-0c7b-4e47-bc82-490a2b76cd7b None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:10.560897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514fe48-e874-4b86-b93a-e04c4b567b15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:10.561496 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514fe48-e874-4b86-b93a-e04c4b567b15 service nova] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:10.561773 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514fe48-e874-4b86-b93a-e04c4b567b15 service nova] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:10.562044 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514fe48-e874-4b86-b93a-e04c4b567b15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:10.570845 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514fe48-e874-4b86-b93a-e04c4b567b15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:10.572511 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514fe48-e874-4b86-b93a-e04c4b567b15 service nova] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:10.582676 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 581/1141] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:12.304201 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef318855-324a-4895-8890-fc855527407a None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:12.304727 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef318855-324a-4895-8890-fc855527407a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:12.304727 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef318855-324a-4895-8890-fc855527407a None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:12.306077 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 561/1142] 10.222.0.61 () {54 vars in 961 bytes} [Fri Aug 19 19:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:12.378078 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cba3da-9844-48f1-a2f3-11b44be74617 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:12.378650 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cba3da-9844-48f1-a2f3-11b44be74617 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:12.378650 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cba3da-9844-48f1-a2f3-11b44be74617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:12.403014 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-a4cba3da-9844-48f1-a2f3-11b44be74617 None None] MFA Rules not processed for user `4aab18dc39cf4d119ba5f07fda334ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:12.404239 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-a4cba3da-9844-48f1-a2f3-11b44be74617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:12.415922 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 582/1143] 10.222.0.61 () {58 vars in 1058 bytes} [Fri Aug 19 19:28:12 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:12.423377 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef318855-324a-4895-8890-fc855527407a None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:12.436603 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef318855-324a-4895-8890-fc855527407a None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:12.441925 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67285f-35bf-4b42-92a1-a4039d8e6de6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aab18dc39cf4d119ba5f07fda334ec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:12.442516 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67285f-35bf-4b42-92a1-a4039d8e6de6 service placement] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:12.442817 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67285f-35bf-4b42-92a1-a4039d8e6de6 service placement] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:12.443085 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67285f-35bf-4b42-92a1-a4039d8e6de6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:12.451305 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67285f-35bf-4b42-92a1-a4039d8e6de6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:12.452882 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67285f-35bf-4b42-92a1-a4039d8e6de6 service placement] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:12.463574 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 562/1144] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:12 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:21.842721 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1b7e1-6a5b-46b3-b43b-ed6eb7be96f8 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:21.843261 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1b7e1-6a5b-46b3-b43b-ed6eb7be96f8 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:21.843261 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1b7e1-6a5b-46b3-b43b-ed6eb7be96f8 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:21.844645 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 583/1145] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:21.849347 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c2936-e27a-4c9f-b2f0-de56dfe22ba7 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:21.849933 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c2936-e27a-4c9f-b2f0-de56dfe22ba7 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:21.849933 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c2936-e27a-4c9f-b2f0-de56dfe22ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:21.870228 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-971c2936-e27a-4c9f-b2f0-de56dfe22ba7 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:21.871451 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-971c2936-e27a-4c9f-b2f0-de56dfe22ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:21.879270 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 563/1146] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:28:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:28:22.038969 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1b7e1-6a5b-46b3-b43b-ed6eb7be96f8 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:22.046349 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=80 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:28:22.053798 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1b7e1-6a5b-46b3-b43b-ed6eb7be96f8 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:22.058217 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537ab0a-74a8-40d1-9f4f-8d66dd00269b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:22.059136 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537ab0a-74a8-40d1-9f4f-8d66dd00269b service nova] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:22.059623 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537ab0a-74a8-40d1-9f4f-8d66dd00269b service nova] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:22.060082 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537ab0a-74a8-40d1-9f4f-8d66dd00269b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:22.069713 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537ab0a-74a8-40d1-9f4f-8d66dd00269b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:22.071356 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537ab0a-74a8-40d1-9f4f-8d66dd00269b service nova] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:22.081012 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 584/1147] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:22.935240 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3f97e-1752-4663-9976-b2c7c4afff87 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:22.935756 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3f97e-1752-4663-9976-b2c7c4afff87 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:22.935756 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3f97e-1752-4663-9976-b2c7c4afff87 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:22.937065 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 564/1148] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 19:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:22.941987 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dd161-fe56-4a38-a4c0-c01ecbb97ab1 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:22.942398 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dd161-fe56-4a38-a4c0-c01ecbb97ab1 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:22.942591 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dd161-fe56-4a38-a4c0-c01ecbb97ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:22.962227 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-fc2dd161-fe56-4a38-a4c0-c01ecbb97ab1 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:22.963470 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-fc2dd161-fe56-4a38-a4c0-c01ecbb97ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:22.971266 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 585/1149] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 19:28:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:23.128766 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3f97e-1752-4663-9976-b2c7c4afff87 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:23.142272 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3f97e-1752-4663-9976-b2c7c4afff87 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:23.147364 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe8d03-0db1-4514-8fae-1d10f7b197df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:23.147957 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe8d03-0db1-4514-8fae-1d10f7b197df service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:23.148237 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe8d03-0db1-4514-8fae-1d10f7b197df service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:23.148510 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe8d03-0db1-4514-8fae-1d10f7b197df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:23.156680 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe8d03-0db1-4514-8fae-1d10f7b197df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:23.158264 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe8d03-0db1-4514-8fae-1d10f7b197df service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:23.168604 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 565/1150] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:27.310054 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf77091-b8f2-45e9-96be-f7e7cdf481c7 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:27.310708 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf77091-b8f2-45e9-96be-f7e7cdf481c7 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:27.310708 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf77091-b8f2-45e9-96be-f7e7cdf481c7 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:27.312104 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 586/1151] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:27.317407 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ac176-dd6c-4080-9908-159b3a59fd5d None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:27.317854 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ac176-dd6c-4080-9908-159b3a59fd5d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:27.317962 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ac176-dd6c-4080-9908-159b3a59fd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:27.337775 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-563ac176-dd6c-4080-9908-159b3a59fd5d None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:27.338992 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-563ac176-dd6c-4080-9908-159b3a59fd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:27.346640 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 566/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:28:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:27.697747 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf77091-b8f2-45e9-96be-f7e7cdf481c7 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:27.699466 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-9cf77091-b8f2-45e9-96be-f7e7cdf481c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:27.755053 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf77091-b8f2-45e9-96be-f7e7cdf481c7 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:27.759168 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd144d29-04e0-4209-866b-c013e2b1f4be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:27.759764 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd144d29-04e0-4209-866b-c013e2b1f4be service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:27.760042 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd144d29-04e0-4209-866b-c013e2b1f4be service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:27.760314 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd144d29-04e0-4209-866b-c013e2b1f4be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:27.769071 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd144d29-04e0-4209-866b-c013e2b1f4be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:27.770495 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd144d29-04e0-4209-866b-c013e2b1f4be service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:27.781089 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 587/1153] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:30.024112 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1930e-8a03-469f-abe2-029159a50da6 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:30.024719 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1930e-8a03-469f-abe2-029159a50da6 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:30.024719 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1930e-8a03-469f-abe2-029159a50da6 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:30.025977 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 567/1154] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:30.031011 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f084f5-6872-44dd-b969-2af6122039eb None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:30.031493 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f084f5-6872-44dd-b969-2af6122039eb None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:30.031600 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f084f5-6872-44dd-b969-2af6122039eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:30.051324 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-c1f084f5-6872-44dd-b969-2af6122039eb None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:30.053457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-c1f084f5-6872-44dd-b969-2af6122039eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:30.061516 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 588/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:28:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:30.407031 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1930e-8a03-469f-abe2-029159a50da6 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:30.408714 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-04b1930e-8a03-469f-abe2-029159a50da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:30.421852 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1930e-8a03-469f-abe2-029159a50da6 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:30.425311 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faace63b-4bbe-498b-a37f-ac0d77963746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:30.425904 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faace63b-4bbe-498b-a37f-ac0d77963746 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:30.426183 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faace63b-4bbe-498b-a37f-ac0d77963746 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:30.426454 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faace63b-4bbe-498b-a37f-ac0d77963746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:30.435950 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faace63b-4bbe-498b-a37f-ac0d77963746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:30.437388 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faace63b-4bbe-498b-a37f-ac0d77963746 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:30.447965 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 568/1156] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 19:28:34.153283 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a45665-4e53-47d2-9930-7d2e4ceff496 None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:34.153844 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a45665-4e53-47d2-9930-7d2e4ceff496 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:34.153844 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a45665-4e53-47d2-9930-7d2e4ceff496 None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:34.155326 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 589/1157] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:34.160340 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e417a7-1cbb-4366-aecb-1157dc2bf2ae None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:34.160780 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e417a7-1cbb-4366-aecb-1157dc2bf2ae None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:34.160888 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e417a7-1cbb-4366-aecb-1157dc2bf2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:34.181691 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-d6e417a7-1cbb-4366-aecb-1157dc2bf2ae None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:34.182924 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-d6e417a7-1cbb-4366-aecb-1157dc2bf2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:34.190698 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 569/1158] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:28:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:34.766947 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a45665-4e53-47d2-9930-7d2e4ceff496 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:34.768563 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-63a45665-4e53-47d2-9930-7d2e4ceff496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:34.825672 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a45665-4e53-47d2-9930-7d2e4ceff496 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:34.829059 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd5c58-05b6-4453-985b-680687f65092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23bbd8bfe6924ea2a6fd35513f830cb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:34.829663 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd5c58-05b6-4453-985b-680687f65092 service cinder] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:34.829941 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd5c58-05b6-4453-985b-680687f65092 service cinder] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:34.830214 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd5c58-05b6-4453-985b-680687f65092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:34.838923 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd5c58-05b6-4453-985b-680687f65092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:34.840352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd5c58-05b6-4453-985b-680687f65092 service cinder] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:34.849581 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 590/1159] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:37.044735 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0bfe5-2de0-44e5-af34-0e55480dd55c None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:37.045292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0bfe5-2de0-44e5-af34-0e55480dd55c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:37.045292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0bfe5-2de0-44e5-af34-0e55480dd55c None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:37.046658 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 570/1160] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 19:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:28:37.051732 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334d617-9b88-4f86-8821-e860923e3baf None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:37.052659 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334d617-9b88-4f86-8821-e860923e3baf None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:37.052905 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334d617-9b88-4f86-8821-e860923e3baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:37.072869 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-2334d617-9b88-4f86-8821-e860923e3baf None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:28:37.074085 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-2334d617-9b88-4f86-8821-e860923e3baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:37.081962 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 591/1161] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 19:28:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:28:37.669372 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0bfe5-2de0-44e5-af34-0e55480dd55c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:28:37.671051 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8ab0bfe5-2de0-44e5-af34-0e55480dd55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:28:37.683842 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0bfe5-2de0-44e5-af34-0e55480dd55c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:28:37.687567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e04fd-d6d0-44c8-bba4-a32d3612c5fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23bbd8bfe6924ea2a6fd35513f830cb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:28:37.688151 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e04fd-d6d0-44c8-bba4-a32d3612c5fe service cinder] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:28:37.688424 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e04fd-d6d0-44c8-bba4-a32d3612c5fe service cinder] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:28:37.688690 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e04fd-d6d0-44c8-bba4-a32d3612c5fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:28:37.698157 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e04fd-d6d0-44c8-bba4-a32d3612c5fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:28:37.699615 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e04fd-d6d0-44c8-bba4-a32d3612c5fe service cinder] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:28:37.709585 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 571/1162] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:28:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:28:47.066671 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=66 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:28:47.704929 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=42 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:29:52.883312 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68c3fa-590e-407f-ab7f-dc03846fe070 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:52.883927 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68c3fa-590e-407f-ab7f-dc03846fe070 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:52.883927 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68c3fa-590e-407f-ab7f-dc03846fe070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:52.902284 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4def9e9-c858-484c-a149-151bc7b6f5f9 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:52.902886 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4def9e9-c858-484c-a149-151bc7b6f5f9 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:52.902886 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4def9e9-c858-484c-a149-151bc7b6f5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:52.903392 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-3d68c3fa-590e-407f-ab7f-dc03846fe070 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:52.904618 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-3d68c3fa-590e-407f-ab7f-dc03846fe070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:52.912973 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 592/1163] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:29:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:29:52.921165 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfa7e9-1fa5-40ed-96f1-16f62752d802 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:52.921452 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfa7e9-1fa5-40ed-96f1-16f62752d802 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:52.921725 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfa7e9-1fa5-40ed-96f1-16f62752d802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:52.922240 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c4def9e9-c858-484c-a149-151bc7b6f5f9 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:52.923467 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c4def9e9-c858-484c-a149-151bc7b6f5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:52.932800 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 572/1164] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:29:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:29:52.940726 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9845109-ab90-4ac7-9179-bc042e08b535 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:52.941013 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9845109-ab90-4ac7-9179-bc042e08b535 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:52.941880 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9845109-ab90-4ac7-9179-bc042e08b535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:52.943662 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-56bfa7e9-1fa5-40ed-96f1-16f62752d802 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:52.944871 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-56bfa7e9-1fa5-40ed-96f1-16f62752d802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:52.952827 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 593/1165] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:29:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:29:52.957873 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfa7e9-1fa5-40ed-96f1-16f62752d802 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:52.961695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-c9845109-ab90-4ac7-9179-bc042e08b535 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:52.962898 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-c9845109-ab90-4ac7-9179-bc042e08b535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:52.966959 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfa7e9-1fa5-40ed-96f1-16f62752d802 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:52.970728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 573/1166] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:29:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:29:52.974960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10861c-e3ba-46f7-a584-228a1b1f96c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:52.974960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10861c-e3ba-46f7-a584-228a1b1f96c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:52.974960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10861c-e3ba-46f7-a584-228a1b1f96c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:52.974960 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10861c-e3ba-46f7-a584-228a1b1f96c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:52.975428 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10861c-e3ba-46f7-a584-228a1b1f96c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:29:52.975428 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10861c-e3ba-46f7-a584-228a1b1f96c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:52.975897 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10861c-e3ba-46f7-a584-228a1b1f96c4 admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:52.978075 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9845109-ab90-4ac7-9179-bc042e08b535 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:52.986980 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9845109-ab90-4ac7-9179-bc042e08b535 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:52.992678 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 594/1167] 10.222.0.61 () {58 vars in 1153 bytes} [Fri Aug 19 19:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:29:52.995758 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10861c-e3ba-46f7-a584-228a1b1f96c4 admin admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:52.997144 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135470e5-9db9-454e-8879-81d682b8b8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:52.997746 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135470e5-9db9-454e-8879-81d682b8b8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:52.998019 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135470e5-9db9-454e-8879-81d682b8b8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:52.998286 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135470e5-9db9-454e-8879-81d682b8b8a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:52.998954 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135470e5-9db9-454e-8879-81d682b8b8a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 19:29:52.999258 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135470e5-9db9-454e-8879-81d682b8b8a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:53.000491 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: WARNING py.warnings [None req-135470e5-9db9-454e-8879-81d682b8b8a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:29:53.000491 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: warnings.warn(msg) Aug 19 19:29:53.000491 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: Aug 19 19:29:53.001313 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135470e5-9db9-454e-8879-81d682b8b8a1 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:53.005501 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10861c-e3ba-46f7-a584-228a1b1f96c4 admin admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:53.010153 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67140300-b89b-485c-b296-6b6952558562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:53.010765 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67140300-b89b-485c-b296-6b6952558562 admin admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:53.011046 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67140300-b89b-485c-b296-6b6952558562 admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:53.011316 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67140300-b89b-485c-b296-6b6952558562 admin admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:53.011930 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67140300-b89b-485c-b296-6b6952558562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:53.012929 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: WARNING py.warnings [None req-67140300-b89b-485c-b296-6b6952558562 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:29:53.012929 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: warnings.warn(msg) Aug 19 19:29:53.012929 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: Aug 19 19:29:53.013157 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 574/1168] 10.222.0.61 () {58 vars in 1153 bytes} [Fri Aug 19 19:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 19:29:53.014259 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67140300-b89b-485c-b296-6b6952558562 admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:53.021632 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135470e5-9db9-454e-8879-81d682b8b8a1 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:53.031369 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135470e5-9db9-454e-8879-81d682b8b8a1 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:53.036846 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb8ed4-cc53-40fc-afcb-4879a467e3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:53.037446 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb8ed4-cc53-40fc-afcb-4879a467e3f9 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:53.037719 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb8ed4-cc53-40fc-afcb-4879a467e3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:53.037987 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb8ed4-cc53-40fc-afcb-4879a467e3f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:53.038667 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb8ed4-cc53-40fc-afcb-4879a467e3f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:53.040622 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb8ed4-cc53-40fc-afcb-4879a467e3f9 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:53.133608 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 595/1169] 10.222.0.61 () {60 vars in 1153 bytes} [Fri Aug 19 19:29:52 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:29:53.137675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67140300-b89b-485c-b296-6b6952558562 admin admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:53.149167 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 575/1170] 10.222.0.61 () {60 vars in 1153 bytes} [Fri Aug 19 19:29:53 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:29:53.150167 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb8ed4-cc53-40fc-afcb-4879a467e3f9 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:53.200802 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67140300-b89b-485c-b296-6b6952558562 admin admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:53.215708 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb8ed4-cc53-40fc-afcb-4879a467e3f9 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:53.221408 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d811d16-0de8-4e3d-881f-df514d8c79c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:53.222228 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d811d16-0de8-4e3d-881f-df514d8c79c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:53.222400 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d811d16-0de8-4e3d-881f-df514d8c79c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:53.222712 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d811d16-0de8-4e3d-881f-df514d8c79c1 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:53.229060 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d811d16-0de8-4e3d-881f-df514d8c79c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:53.229060 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: WARNING py.warnings [None req-2d811d16-0de8-4e3d-881f-df514d8c79c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:29:53.229060 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: warnings.warn(msg) Aug 19 19:29:53.229060 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: Aug 19 19:29:53.229060 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d811d16-0de8-4e3d-881f-df514d8c79c1 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:53.259126 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f6b7c-2749-4755-be2e-7c1c8ddec23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:53.259738 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f6b7c-2749-4755-be2e-7c1c8ddec23b admin admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:53.260019 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f6b7c-2749-4755-be2e-7c1c8ddec23b admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:53.260293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f6b7c-2749-4755-be2e-7c1c8ddec23b admin admin] PATH_INFO: `/v3/users` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:53.260907 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f6b7c-2749-4755-be2e-7c1c8ddec23b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:53.262877 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f6b7c-2749-4755-be2e-7c1c8ddec23b admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:53.304850 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 576/1171] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Aug 19 19:29:53 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:29:53.308896 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d811d16-0de8-4e3d-881f-df514d8c79c1 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:53.318829 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d811d16-0de8-4e3d-881f-df514d8c79c1 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:53.323392 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd33e2-4992-4c02-81e3-84ae02a0c644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:53.323962 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd33e2-4992-4c02-81e3-84ae02a0c644 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:53.324234 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd33e2-4992-4c02-81e3-84ae02a0c644 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:53.324498 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd33e2-4992-4c02-81e3-84ae02a0c644 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:53.325190 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd33e2-4992-4c02-81e3-84ae02a0c644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:53.326719 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd33e2-4992-4c02-81e3-84ae02a0c644 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:53.336918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 577/1172] 10.222.0.61 () {58 vars in 1122 bytes} [Fri Aug 19 19:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 19:29:53.340677 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd33e2-4992-4c02-81e3-84ae02a0c644 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:53.350590 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd33e2-4992-4c02-81e3-84ae02a0c644 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:53.355479 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2e60d-e3cd-43d9-99fd-484688634a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:53.356069 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2e60d-e3cd-43d9-99fd-484688634a87 admin admin] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:53.356351 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2e60d-e3cd-43d9-99fd-484688634a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:53.356632 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2e60d-e3cd-43d9-99fd-484688634a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:53.357258 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2e60d-e3cd-43d9-99fd-484688634a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:53.359010 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2e60d-e3cd-43d9-99fd-484688634a87 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:53.363778 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 596/1173] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Aug 19 19:29:53 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:29:53.366439 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f6b7c-2749-4755-be2e-7c1c8ddec23b admin admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:53.371398 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 578/1174] 10.222.0.61 () {58 vars in 1122 bytes} [Fri Aug 19 19:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 19:29:53.375319 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2e60d-e3cd-43d9-99fd-484688634a87 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:53.378445 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f6b7c-2749-4755-be2e-7c1c8ddec23b admin admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:53.384388 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60b0ba-5411-4b10-8d7c-7933546b63f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:53.384758 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2e60d-e3cd-43d9-99fd-484688634a87 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:53.384957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60b0ba-5411-4b10-8d7c-7933546b63f1 admin admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:53.385237 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60b0ba-5411-4b10-8d7c-7933546b63f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:53.385511 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60b0ba-5411-4b10-8d7c-7933546b63f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:53.386148 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60b0ba-5411-4b10-8d7c-7933546b63f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:53.387958 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60b0ba-5411-4b10-8d7c-7933546b63f1 admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:53.389503 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0069c7-9637-4a29-a59c-929986b219b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:53.390140 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0069c7-9637-4a29-a59c-929986b219b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:53.390418 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0069c7-9637-4a29-a59c-929986b219b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:53.390728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0069c7-9637-4a29-a59c-929986b219b8 admin admin] PATH_INFO: `/v3/projects/dabc9e7ae707469f8eb643d854bcdd7c/users/796e2eff2b57416686cbe9be13c772e8/roles/83a904d35afc48fe9f8d55c0fd1597d8` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:53.398988 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 597/1175] 10.222.0.61 () {58 vars in 1122 bytes} [Fri Aug 19 19:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 19:29:53.402869 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60b0ba-5411-4b10-8d7c-7933546b63f1 admin admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:53.407619 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0069c7-9637-4a29-a59c-929986b219b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dabc9e7ae707469f8eb643d854bcdd7c, user_id=796e2eff2b57416686cbe9be13c772e8, role_id=83a904d35afc48fe9f8d55c0fd1597d8)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:53.411117 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0069c7-9637-4a29-a59c-929986b219b8 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:53.413408 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60b0ba-5411-4b10-8d7c-7933546b63f1 admin admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:53.418729 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bb381-12a5-4961-b03f-d636f609f87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:53.419327 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bb381-12a5-4961-b03f-d636f609f87d admin admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:53.419612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bb381-12a5-4961-b03f-d636f609f87d admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:53.419889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bb381-12a5-4961-b03f-d636f609f87d admin admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:53.420572 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bb381-12a5-4961-b03f-d636f609f87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:53.422321 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bb381-12a5-4961-b03f-d636f609f87d admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:53.433072 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 598/1176] 10.222.0.61 () {58 vars in 1122 bytes} [Fri Aug 19 19:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 19:29:53.437234 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bb381-12a5-4961-b03f-d636f609f87d admin admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:53.447316 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bb381-12a5-4961-b03f-d636f609f87d admin admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:53.451944 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9025620-430b-4a7a-a323-c079f48c5678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:53.452573 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9025620-430b-4a7a-a323-c079f48c5678 admin admin] REQUEST_METHOD: `PUT` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:53.452855 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9025620-430b-4a7a-a323-c079f48c5678 admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:53.453130 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9025620-430b-4a7a-a323-c079f48c5678 admin admin] PATH_INFO: `/v3/projects/0b9945a2d9a84d71b7f496124430f0fa/users/e722f1a4b82549408a34423bd1a6a5b6/roles/83a904d35afc48fe9f8d55c0fd1597d8` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:53.468135 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9025620-430b-4a7a-a323-c079f48c5678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b9945a2d9a84d71b7f496124430f0fa, user_id=e722f1a4b82549408a34423bd1a6a5b6, role_id=83a904d35afc48fe9f8d55c0fd1597d8)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:53.469149 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: WARNING py.warnings [None req-c9025620-430b-4a7a-a323-c079f48c5678 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:29:53.469149 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: warnings.warn(msg) Aug 19 19:29:53.469149 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: Aug 19 19:29:53.471338 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9025620-430b-4a7a-a323-c079f48c5678 admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:53.492608 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 579/1177] 10.222.0.61 () {60 vars in 1483 bytes} [Fri Aug 19 19:29:53 2022] PUT /identity/v3/projects/dabc9e7ae707469f8eb643d854bcdd7c/users/796e2eff2b57416686cbe9be13c772e8/roles/83a904d35afc48fe9f8d55c0fd1597d8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 19:29:53.497644 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066a5ff-2090-44bb-83c2-5c2da30ac144 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:53.497928 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066a5ff-2090-44bb-83c2-5c2da30ac144 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:53.498196 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066a5ff-2090-44bb-83c2-5c2da30ac144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:53.515853 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-4066a5ff-2090-44bb-83c2-5c2da30ac144 None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:53.518382 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-4066a5ff-2090-44bb-83c2-5c2da30ac144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:53.561771 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 599/1178] 10.222.0.61 () {60 vars in 1483 bytes} [Fri Aug 19 19:29:53 2022] PUT /identity/v3/projects/0b9945a2d9a84d71b7f496124430f0fa/users/e722f1a4b82549408a34423bd1a6a5b6/roles/83a904d35afc48fe9f8d55c0fd1597d8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 19:29:53.565565 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:29:53.566721 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07297e1-0c78-4424-9033-7043f77e12da None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:53.567158 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07297e1-0c78-4424-9033-7043f77e12da None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:53.567506 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07297e1-0c78-4424-9033-7043f77e12da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:53.574812 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:29:53.578132 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 580/1179] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:29:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:29:53.589355 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066a5ff-2090-44bb-83c2-5c2da30ac144 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:53.591033 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-c07297e1-0c78-4424-9033-7043f77e12da None None] MFA Rules not processed for user `7ffe86579b7344d19702549b20bcc927`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:29:53.592227 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-c07297e1-0c78-4424-9033-7043f77e12da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:29:53.646285 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066a5ff-2090-44bb-83c2-5c2da30ac144 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:53.654633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 600/1180] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:29:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:29:53.664699 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07297e1-0c78-4424-9033-7043f77e12da None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:29:53.695776 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c8683-2efb-4cfe-b178-cbdadee49e52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:53.696379 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c8683-2efb-4cfe-b178-cbdadee49e52 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:53.696654 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c8683-2efb-4cfe-b178-cbdadee49e52 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:53.696923 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c8683-2efb-4cfe-b178-cbdadee49e52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:53.706413 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c8683-2efb-4cfe-b178-cbdadee49e52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:53.708432 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c8683-2efb-4cfe-b178-cbdadee49e52 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:53.717962 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 581/1181] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 19:29:53.720313 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07297e1-0c78-4424-9033-7043f77e12da None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:29:53.724890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924986dd-e05f-4281-b84a-4780f23d481a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:29:53.725381 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924986dd-e05f-4281-b84a-4780f23d481a service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:29:53.725654 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924986dd-e05f-4281-b84a-4780f23d481a service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:29:53.725919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924986dd-e05f-4281-b84a-4780f23d481a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:29:53.735065 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924986dd-e05f-4281-b84a-4780f23d481a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:29:53.736502 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924986dd-e05f-4281-b84a-4780f23d481a service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:29:53.746118 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 601/1182] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:29:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 19:30:00.129825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20ba8a-1ef4-48fd-a4c3-931794fe4578 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:00.130641 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20ba8a-1ef4-48fd-a4c3-931794fe4578 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:00.130641 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20ba8a-1ef4-48fd-a4c3-931794fe4578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:00.167860 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-9a20ba8a-1ef4-48fd-a4c3-931794fe4578 None None] MFA Rules not processed for user `e722f1a4b82549408a34423bd1a6a5b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:00.169845 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-9a20ba8a-1ef4-48fd-a4c3-931794fe4578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:00.281375 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 582/1183] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:30:00 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:00.286228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924986dd-e05f-4281-b84a-4780f23d481a service neutron] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:00.302103 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924986dd-e05f-4281-b84a-4780f23d481a service neutron] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:00.307295 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b34c90-fce6-4e2c-85ef-439b68cce403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:00.307994 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b34c90-fce6-4e2c-85ef-439b68cce403 admin admin] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:00.308279 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b34c90-fce6-4e2c-85ef-439b68cce403 admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:00.308555 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b34c90-fce6-4e2c-85ef-439b68cce403 admin admin] PATH_INFO: `/v3/projects` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:00.309259 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b34c90-fce6-4e2c-85ef-439b68cce403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:00.311352 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b34c90-fce6-4e2c-85ef-439b68cce403 admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:00.415114 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 602/1184] 10.222.0.61 () {60 vars in 1153 bytes} [Fri Aug 19 19:30:00 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:30:00.420159 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20ba8a-1ef4-48fd-a4c3-931794fe4578 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:00.433260 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20ba8a-1ef4-48fd-a4c3-931794fe4578 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:00.537619 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=100 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:30:00.579366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf5bbe-7f18-4cf2-a9ca-33d6f835bd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:00.580095 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf5bbe-7f18-4cf2-a9ca-33d6f835bd5d admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:00.580380 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf5bbe-7f18-4cf2-a9ca-33d6f835bd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:00.580656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf5bbe-7f18-4cf2-a9ca-33d6f835bd5d admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:00.582357 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf5bbe-7f18-4cf2-a9ca-33d6f835bd5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:00.584441 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf5bbe-7f18-4cf2-a9ca-33d6f835bd5d admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:00.670215 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 583/1185] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Aug 19 19:30:00 2022] POST /identity/v3/users => generated 296 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:30:00.673755 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b34c90-fce6-4e2c-85ef-439b68cce403 admin admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:00.695306 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b34c90-fce6-4e2c-85ef-439b68cce403 admin admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:00.699253 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa1878-c36e-4e36-b8a6-aa92bd62628d None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:00.699548 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa1878-c36e-4e36-b8a6-aa92bd62628d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:00.699827 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa1878-c36e-4e36-b8a6-aa92bd62628d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:00.700271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f764c-a19a-4b4f-8591-41d3c6ae35a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:00.700994 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f764c-a19a-4b4f-8591-41d3c6ae35a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:00.701344 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f764c-a19a-4b4f-8591-41d3c6ae35a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:00.701713 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f764c-a19a-4b4f-8591-41d3c6ae35a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:00.702509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f764c-a19a-4b4f-8591-41d3c6ae35a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:00.704546 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f764c-a19a-4b4f-8591-41d3c6ae35a5 admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:00.716445 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 603/1186] 10.222.0.61 () {58 vars in 1122 bytes} [Fri Aug 19 19:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 19:30:00.720545 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f764c-a19a-4b4f-8591-41d3c6ae35a5 admin admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:00.733272 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-8eaa1878-c36e-4e36-b8a6-aa92bd62628d None None] MFA Rules not processed for user `796e2eff2b57416686cbe9be13c772e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:00.735145 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-8eaa1878-c36e-4e36-b8a6-aa92bd62628d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:00.735457 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f764c-a19a-4b4f-8591-41d3c6ae35a5 admin admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:00.741736 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49a9d3-aace-4050-aad7-b3e05d15f572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:00.741736 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49a9d3-aace-4050-aad7-b3e05d15f572 admin admin] REQUEST_METHOD: `PUT` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:00.743445 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49a9d3-aace-4050-aad7-b3e05d15f572 admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:00.743445 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49a9d3-aace-4050-aad7-b3e05d15f572 admin admin] PATH_INFO: `/v3/projects/acb5e6ab7b1244579f9f23981b56ab97/users/549cfc4089e14e22aa91b8199ccbe8fa/roles/8fdfbc4aaf68468f89a5ae3450b8488d` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:00.761224 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49a9d3-aace-4050-aad7-b3e05d15f572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb5e6ab7b1244579f9f23981b56ab97, user_id=549cfc4089e14e22aa91b8199ccbe8fa, role_id=8fdfbc4aaf68468f89a5ae3450b8488d)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:00.764184 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49a9d3-aace-4050-aad7-b3e05d15f572 admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:00.813025 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 584/1187] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:30:00 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:00.818436 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa1878-c36e-4e36-b8a6-aa92bd62628d None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:00.829923 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa1878-c36e-4e36-b8a6-aa92bd62628d None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:00.835229 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd04f7-14c5-473d-9647-63bb5629c765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:00.835859 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd04f7-14c5-473d-9647-63bb5629c765 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:00.836130 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd04f7-14c5-473d-9647-63bb5629c765 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:00.836395 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd04f7-14c5-473d-9647-63bb5629c765 admin admin] PATH_INFO: `/v3/projects` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:00.837013 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd04f7-14c5-473d-9647-63bb5629c765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:00.839161 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd04f7-14c5-473d-9647-63bb5629c765 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:00.870160 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 604/1188] 10.222.0.61 () {60 vars in 1483 bytes} [Fri Aug 19 19:30:00 2022] PUT /identity/v3/projects/acb5e6ab7b1244579f9f23981b56ab97/users/549cfc4089e14e22aa91b8199ccbe8fa/roles/8fdfbc4aaf68468f89a5ae3450b8488d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 19:30:00.874454 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49a9d3-aace-4050-aad7-b3e05d15f572 admin admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:00.947389 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:30:00.961496 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49a9d3-aace-4050-aad7-b3e05d15f572 admin admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:00.966960 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 585/1189] 10.222.0.61 () {60 vars in 1153 bytes} [Fri Aug 19 19:30:00 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 19:30:00.971202 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd04f7-14c5-473d-9647-63bb5629c765 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:01.104685 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512096a-f790-4a0b-be7c-6a0567f5e9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:01.105015 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd04f7-14c5-473d-9647-63bb5629c765 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:01.105240 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512096a-f790-4a0b-be7c-6a0567f5e9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:01.105521 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512096a-f790-4a0b-be7c-6a0567f5e9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:01.105796 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512096a-f790-4a0b-be7c-6a0567f5e9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:01.106445 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512096a-f790-4a0b-be7c-6a0567f5e9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:01.108150 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512096a-f790-4a0b-be7c-6a0567f5e9a0 admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:01.111290 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ad3d0-d403-4a63-ac82-942c947f6c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:01.112125 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ad3d0-d403-4a63-ac82-942c947f6c35 admin admin] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:01.112478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ad3d0-d403-4a63-ac82-942c947f6c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:01.113498 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ad3d0-d403-4a63-ac82-942c947f6c35 admin admin] PATH_INFO: `/v3/users` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:01.114292 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ad3d0-d403-4a63-ac82-942c947f6c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:01.116468 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ad3d0-d403-4a63-ac82-942c947f6c35 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:01.131943 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 605/1190] 10.222.0.61 () {58 vars in 1122 bytes} [Fri Aug 19 19:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:30:01.135983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512096a-f790-4a0b-be7c-6a0567f5e9a0 admin admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:01.159245 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512096a-f790-4a0b-be7c-6a0567f5e9a0 admin admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:01.166293 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e8a6d-b310-404f-9219-110e9e0ddcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:01.167071 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e8a6d-b310-404f-9219-110e9e0ddcda admin admin] REQUEST_METHOD: `PUT` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:01.167350 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e8a6d-b310-404f-9219-110e9e0ddcda admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:01.167683 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e8a6d-b310-404f-9219-110e9e0ddcda admin admin] PATH_INFO: `/v3/projects/acb5e6ab7b1244579f9f23981b56ab97/users/549cfc4089e14e22aa91b8199ccbe8fa/roles/8fdfbc4aaf68468f89a5ae3450b8488d` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:01.169697 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e8a6d-b310-404f-9219-110e9e0ddcda admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb5e6ab7b1244579f9f23981b56ab97, user_id=549cfc4089e14e22aa91b8199ccbe8fa, role_id=8fdfbc4aaf68468f89a5ae3450b8488d)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:01.172630 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e8a6d-b310-404f-9219-110e9e0ddcda admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:01.185429 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 606/1191] 10.222.0.61 () {60 vars in 1483 bytes} [Fri Aug 19 19:30:01 2022] PUT /identity/v3/projects/acb5e6ab7b1244579f9f23981b56ab97/users/549cfc4089e14e22aa91b8199ccbe8fa/roles/8fdfbc4aaf68468f89a5ae3450b8488d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:30:01.221214 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 586/1192] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Aug 19 19:30:00 2022] POST /identity/v3/users => generated 299 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 19:30:01.225427 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e8a6d-b310-404f-9219-110e9e0ddcda admin admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:01.306215 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e8a6d-b310-404f-9219-110e9e0ddcda admin admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:01.314291 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543666c-03e6-41c7-aa80-8fd7cdcc500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:01.315051 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543666c-03e6-41c7-aa80-8fd7cdcc500f admin admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:01.315430 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543666c-03e6-41c7-aa80-8fd7cdcc500f admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:01.315781 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543666c-03e6-41c7-aa80-8fd7cdcc500f admin admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:01.316564 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543666c-03e6-41c7-aa80-8fd7cdcc500f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:01.319381 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543666c-03e6-41c7-aa80-8fd7cdcc500f admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:01.336061 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 607/1193] 10.222.0.61 () {58 vars in 1122 bytes} [Fri Aug 19 19:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:30:01.339757 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ad3d0-d403-4a63-ac82-942c947f6c35 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:01.360715 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ad3d0-d403-4a63-ac82-942c947f6c35 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:01.367646 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc33af-38a7-4297-842c-1ad69aceacb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:01.369027 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc33af-38a7-4297-842c-1ad69aceacb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:01.369464 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc33af-38a7-4297-842c-1ad69aceacb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:01.369745 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc33af-38a7-4297-842c-1ad69aceacb9 admin admin] PATH_INFO: `/v3/projects/0d793d4c7903488fafdaa791894056fd/users/3a4a08ef712c433e97e07ab2e94695a9/roles/8fdfbc4aaf68468f89a5ae3450b8488d` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:01.396153 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc33af-38a7-4297-842c-1ad69aceacb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d793d4c7903488fafdaa791894056fd, user_id=3a4a08ef712c433e97e07ab2e94695a9, role_id=8fdfbc4aaf68468f89a5ae3450b8488d)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:01.399412 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc33af-38a7-4297-842c-1ad69aceacb9 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:01.466366 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 587/1194] 10.222.0.61 () {60 vars in 1483 bytes} [Fri Aug 19 19:30:01 2022] PUT /identity/v3/projects/0d793d4c7903488fafdaa791894056fd/users/3a4a08ef712c433e97e07ab2e94695a9/roles/8fdfbc4aaf68468f89a5ae3450b8488d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:30:01.471358 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543666c-03e6-41c7-aa80-8fd7cdcc500f admin admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:01.492943 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543666c-03e6-41c7-aa80-8fd7cdcc500f admin admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:01.605686 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99d082-54b6-4cba-b2a7-d12a3751d761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:01.606221 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99d082-54b6-4cba-b2a7-d12a3751d761 admin admin] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:01.606616 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99d082-54b6-4cba-b2a7-d12a3751d761 admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:01.606981 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99d082-54b6-4cba-b2a7-d12a3751d761 admin admin] PATH_INFO: `/v3/roles` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:01.607823 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99d082-54b6-4cba-b2a7-d12a3751d761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:01.609615 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99d082-54b6-4cba-b2a7-d12a3751d761 admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:01.625243 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 608/1195] 10.222.0.61 () {58 vars in 1122 bytes} [Fri Aug 19 19:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 19:30:01.631413 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc33af-38a7-4297-842c-1ad69aceacb9 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:01.682411 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc33af-38a7-4297-842c-1ad69aceacb9 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:01.688631 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd7daf-20ad-475b-b0a1-5cbaac6d24ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:01.689588 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd7daf-20ad-475b-b0a1-5cbaac6d24ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:01.689734 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd7daf-20ad-475b-b0a1-5cbaac6d24ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:01.690072 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd7daf-20ad-475b-b0a1-5cbaac6d24ea admin admin] PATH_INFO: `/v3/projects/0d793d4c7903488fafdaa791894056fd/users/3a4a08ef712c433e97e07ab2e94695a9/roles/8fdfbc4aaf68468f89a5ae3450b8488d` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:01.693157 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd7daf-20ad-475b-b0a1-5cbaac6d24ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d793d4c7903488fafdaa791894056fd, user_id=3a4a08ef712c433e97e07ab2e94695a9, role_id=8fdfbc4aaf68468f89a5ae3450b8488d)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:01.696051 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd7daf-20ad-475b-b0a1-5cbaac6d24ea admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:01.714096 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:30:01.742944 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 588/1196] 10.222.0.61 () {60 vars in 1483 bytes} [Fri Aug 19 19:30:01 2022] PUT /identity/v3/projects/0d793d4c7903488fafdaa791894056fd/users/3a4a08ef712c433e97e07ab2e94695a9/roles/8fdfbc4aaf68468f89a5ae3450b8488d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:30:08.576311 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e890fd-3b64-479b-a1da-cefe9d996bdd None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:08.579567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e890fd-3b64-479b-a1da-cefe9d996bdd None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:08.579567 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e890fd-3b64-479b-a1da-cefe9d996bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:08.606374 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:30:08.617008 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-76e890fd-3b64-479b-a1da-cefe9d996bdd None None] MFA Rules not processed for user `549cfc4089e14e22aa91b8199ccbe8fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:08.618724 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-76e890fd-3b64-479b-a1da-cefe9d996bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:08.736958 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 609/1197] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:30:08 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:08.756402 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd7daf-20ad-475b-b0a1-5cbaac6d24ea admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:08.758208 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-13bd7daf-20ad-475b-b0a1-5cbaac6d24ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:08.893272 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd7daf-20ad-475b-b0a1-5cbaac6d24ea admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:08.899436 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc1a79-b708-432d-ad64-3d2829b29cdf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bca70a332304359bcc9d873ebbe14de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:08.899735 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc1a79-b708-432d-ad64-3d2829b29cdf service glance] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:08.900043 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc1a79-b708-432d-ad64-3d2829b29cdf service glance] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:08.900313 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc1a79-b708-432d-ad64-3d2829b29cdf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:09.023835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc1a79-b708-432d-ad64-3d2829b29cdf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:09.025497 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc1a79-b708-432d-ad64-3d2829b29cdf service glance] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:09.040405 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 589/1198] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:08 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:30:09.172479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc3d7e-f750-456d-87ba-3129227f949d None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:09.172772 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc3d7e-f750-456d-87ba-3129227f949d None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:09.173055 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc3d7e-f750-456d-87ba-3129227f949d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:09.227408 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-57fc3d7e-f750-456d-87ba-3129227f949d None None] MFA Rules not processed for user `3a4a08ef712c433e97e07ab2e94695a9`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:09.229900 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-57fc3d7e-f750-456d-87ba-3129227f949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:09.329890 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 610/1199] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:30:09 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:09.345041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc1a79-b708-432d-ad64-3d2829b29cdf service glance] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:09.345041 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-aebc1a79-b708-432d-ad64-3d2829b29cdf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:09.357725 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc1a79-b708-432d-ad64-3d2829b29cdf service glance] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:09.363935 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f7538-0bbd-43ca-a124-d1cf5cabbfcb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bca70a332304359bcc9d873ebbe14de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:09.364082 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f7538-0bbd-43ca-a124-d1cf5cabbfcb service glance] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:09.364283 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f7538-0bbd-43ca-a124-d1cf5cabbfcb service glance] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:09.364631 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f7538-0bbd-43ca-a124-d1cf5cabbfcb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:09.454695 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f7538-0bbd-43ca-a124-d1cf5cabbfcb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:09.456858 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f7538-0bbd-43ca-a124-d1cf5cabbfcb service glance] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:09.468930 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 590/1200] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:09 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:30:19.317073 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=63 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:30:19.464739 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:INSERT=1,keystone:SELECT=78 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:30:19.482624 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed33a77-fcd8-4857-8b3a-0786b4c07a3a None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:19.482920 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed33a77-fcd8-4857-8b3a-0786b4c07a3a None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:19.483210 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed33a77-fcd8-4857-8b3a-0786b4c07a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:19.504949 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-1ed33a77-fcd8-4857-8b3a-0786b4c07a3a None None] MFA Rules not processed for user `796e2eff2b57416686cbe9be13c772e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:19.506379 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-1ed33a77-fcd8-4857-8b3a-0786b4c07a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:19.518261 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 611/1201] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:30:19 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:19.813304 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e919e47-7f1d-4523-84a1-ba913bcc7571 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:19.813587 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e919e47-7f1d-4523-84a1-ba913bcc7571 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:19.813864 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e919e47-7f1d-4523-84a1-ba913bcc7571 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:19.815845 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 591/1202] 10.222.0.61 () {54 vars in 962 bytes} [Fri Aug 19 19:30:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:30:19.824058 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbb09e-74e8-459b-bcf4-71293677372b None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:19.824336 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbb09e-74e8-459b-bcf4-71293677372b None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:19.824787 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbb09e-74e8-459b-bcf4-71293677372b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:19.844656 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-30bbb09e-74e8-459b-bcf4-71293677372b None None] MFA Rules not processed for user `54c899e786614c18b2bf4334ceb2f891`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:19.845859 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-30bbb09e-74e8-459b-bcf4-71293677372b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:19.917198 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 612/1203] 10.222.0.61 () {58 vars in 1059 bytes} [Fri Aug 19 19:30:19 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:30:19.922435 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc5660-a3c3-42a6-a337-5fb44cc80f17 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:19.922741 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc5660-a3c3-42a6-a337-5fb44cc80f17 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:19.928145 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc5660-a3c3-42a6-a337-5fb44cc80f17 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:19.928145 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 592/1204] 10.222.0.61 () {54 vars in 912 bytes} [Fri Aug 19 19:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:30:19.930590 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91346b0-5c92-477d-9f47-732bd4f72071 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:19.930590 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91346b0-5c92-477d-9f47-732bd4f72071 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:19.930806 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91346b0-5c92-477d-9f47-732bd4f72071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:19.959278 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-e91346b0-5c92-477d-9f47-732bd4f72071 None None] MFA Rules not processed for user `54c899e786614c18b2bf4334ceb2f891`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:19.960628 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-e91346b0-5c92-477d-9f47-732bd4f72071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:19.969918 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 613/1205] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Aug 19 19:30:19 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:19.981619 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc5660-a3c3-42a6-a337-5fb44cc80f17 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:19.993268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc5660-a3c3-42a6-a337-5fb44cc80f17 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:19.997000 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601ce3d-7dc8-4f85-a376-d9752d88ff53 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bca70a332304359bcc9d873ebbe14de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:19.997594 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601ce3d-7dc8-4f85-a376-d9752d88ff53 service glance] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:19.997873 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601ce3d-7dc8-4f85-a376-d9752d88ff53 service glance] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:19.998146 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601ce3d-7dc8-4f85-a376-d9752d88ff53 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:20.009774 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601ce3d-7dc8-4f85-a376-d9752d88ff53 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:20.011513 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601ce3d-7dc8-4f85-a376-d9752d88ff53 service glance] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:20.024136 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 593/1206] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:19 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:30:20.463739 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab9178-2fba-44cb-9f7b-5f651d5fcd4d None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:20.464321 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab9178-2fba-44cb-9f7b-5f651d5fcd4d None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:20.464321 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab9178-2fba-44cb-9f7b-5f651d5fcd4d None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:20.465647 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 614/1207] 10.222.0.61 () {54 vars in 912 bytes} [Fri Aug 19 19:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:30:20.470772 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84c7ce-5abd-4f5a-95bb-65b204b34749 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:20.471212 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84c7ce-5abd-4f5a-95bb-65b204b34749 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:20.471528 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84c7ce-5abd-4f5a-95bb-65b204b34749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:20.492164 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-2c84c7ce-5abd-4f5a-95bb-65b204b34749 None None] MFA Rules not processed for user `84bd0bde9a164516a26768a3eb44fdec`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:20.493376 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-2c84c7ce-5abd-4f5a-95bb-65b204b34749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:20.548333 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 594/1208] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Aug 19 19:30:20 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:20.560490 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab9178-2fba-44cb-9f7b-5f651d5fcd4d None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:20.571857 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab9178-2fba-44cb-9f7b-5f651d5fcd4d None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:20.575448 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799ba78-54ce-4cf5-809c-6b9617837293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:20.576049 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799ba78-54ce-4cf5-809c-6b9617837293 service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:20.576322 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799ba78-54ce-4cf5-809c-6b9617837293 service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:20.576591 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799ba78-54ce-4cf5-809c-6b9617837293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:20.584616 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799ba78-54ce-4cf5-809c-6b9617837293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:20.586069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799ba78-54ce-4cf5-809c-6b9617837293 service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:20.595343 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 615/1209] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:20 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:30:21.219075 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543abe06-2bc5-4cb1-a042-6582927a8030 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:21.219437 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543abe06-2bc5-4cb1-a042-6582927a8030 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:21.219662 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543abe06-2bc5-4cb1-a042-6582927a8030 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:21.223626 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 595/1210] 10.222.0.61 () {54 vars in 962 bytes} [Fri Aug 19 19:30:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:30:21.229599 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e1a99-7eee-47ff-9dba-a6362d50f55b None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:21.229959 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e1a99-7eee-47ff-9dba-a6362d50f55b None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:21.230306 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e1a99-7eee-47ff-9dba-a6362d50f55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:21.250202 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012fc68-542b-4990-95a7-069087969f64 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:21.250202 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012fc68-542b-4990-95a7-069087969f64 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:21.250202 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012fc68-542b-4990-95a7-069087969f64 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:21.250202 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 596/1211] 10.222.0.61 () {54 vars in 961 bytes} [Fri Aug 19 19:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:30:21.255391 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb36b4d-206a-466b-989f-16bd48c7cad1 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:21.255701 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb36b4d-206a-466b-989f-16bd48c7cad1 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:21.256045 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb36b4d-206a-466b-989f-16bd48c7cad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:21.256993 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-ab7e1a99-7eee-47ff-9dba-a6362d50f55b None None] MFA Rules not processed for user `54c899e786614c18b2bf4334ceb2f891`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:21.258279 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-ab7e1a99-7eee-47ff-9dba-a6362d50f55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:21.271172 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 616/1212] 10.222.0.61 () {58 vars in 1059 bytes} [Fri Aug 19 19:30:21 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:30:21.277467 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478d505-ca2b-4251-a455-4786faf1737b None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:21.277716 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-cfb36b4d-206a-466b-989f-16bd48c7cad1 None None] MFA Rules not processed for user `4aab18dc39cf4d119ba5f07fda334ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:21.278138 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478d505-ca2b-4251-a455-4786faf1737b None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:21.278488 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478d505-ca2b-4251-a455-4786faf1737b None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:21.278936 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-cfb36b4d-206a-466b-989f-16bd48c7cad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:21.280258 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 617/1213] 10.222.0.61 () {54 vars in 912 bytes} [Fri Aug 19 19:30:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 19:30:21.286326 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90330815-816f-41af-826b-ac09873485ee None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:21.286713 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90330815-816f-41af-826b-ac09873485ee None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:21.287059 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90330815-816f-41af-826b-ac09873485ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:21.310473 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-90330815-816f-41af-826b-ac09873485ee None None] MFA Rules not processed for user `54c899e786614c18b2bf4334ceb2f891`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:21.311726 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-90330815-816f-41af-826b-ac09873485ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:21.322540 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 618/1214] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Aug 19 19:30:21 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:30:21.334664 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90330815-816f-41af-826b-ac09873485ee None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:21.350375 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90330815-816f-41af-826b-ac09873485ee None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:21.356391 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 597/1215] 10.222.0.61 () {58 vars in 1058 bytes} [Fri Aug 19 19:30:21 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:21.356544 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bb89f-2ad5-4fee-a220-a47e6c6aa6a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:21.357226 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bb89f-2ad5-4fee-a220-a47e6c6aa6a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:21.357570 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bb89f-2ad5-4fee-a220-a47e6c6aa6a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:21.357967 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bb89f-2ad5-4fee-a220-a47e6c6aa6a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:21.364918 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb36b4d-206a-466b-989f-16bd48c7cad1 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:21.379736 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304bb89f-2ad5-4fee-a220-a47e6c6aa6a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:21.381203 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304bb89f-2ad5-4fee-a220-a47e6c6aa6a9 service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:21.381825 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb36b4d-206a-466b-989f-16bd48c7cad1 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:21.392965 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473098fa-c225-42fa-9586-9b0440f949d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aab18dc39cf4d119ba5f07fda334ec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:21.398737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473098fa-c225-42fa-9586-9b0440f949d8 service placement] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:21.398737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473098fa-c225-42fa-9586-9b0440f949d8 service placement] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:21.398737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473098fa-c225-42fa-9586-9b0440f949d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:21.398737 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-473098fa-c225-42fa-9586-9b0440f949d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:21.401850 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 619/1216] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:21 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 19:30:21.410337 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473098fa-c225-42fa-9586-9b0440f949d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:21.412101 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473098fa-c225-42fa-9586-9b0440f949d8 service placement] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:21.425258 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 598/1217] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:21 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:30:31.391173 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=53 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:30:31.419204 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=64 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:30:37.246690 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296f256-c3e8-454d-bd7a-c89354c70a4c None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:37.247219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296f256-c3e8-454d-bd7a-c89354c70a4c None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:37.247662 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296f256-c3e8-454d-bd7a-c89354c70a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:37.275353 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-a296f256-c3e8-454d-bd7a-c89354c70a4c None None] MFA Rules not processed for user `84bd0bde9a164516a26768a3eb44fdec`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:37.276570 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-a296f256-c3e8-454d-bd7a-c89354c70a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:37.284107 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 620/1218] 10.222.0.15 () {58 vars in 1015 bytes} [Fri Aug 19 19:30:37 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:30:37.295844 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473098fa-c225-42fa-9586-9b0440f949d8 service placement] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:37.308217 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473098fa-c225-42fa-9586-9b0440f949d8 service placement] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:37.312400 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de07c4-c3bb-4c78-962c-911e5c0d3f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:37.313079 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de07c4-c3bb-4c78-962c-911e5c0d3f95 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:37.313363 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de07c4-c3bb-4c78-962c-911e5c0d3f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:37.313630 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de07c4-c3bb-4c78-962c-911e5c0d3f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:37.323771 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de07c4-c3bb-4c78-962c-911e5c0d3f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:37.328102 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de07c4-c3bb-4c78-962c-911e5c0d3f95 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:37.338556 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 599/1219] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:37 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:30:38.160136 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198eaf9-cbff-4dd2-acce-051e48c6616d None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:38.160430 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198eaf9-cbff-4dd2-acce-051e48c6616d None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:38.160682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198eaf9-cbff-4dd2-acce-051e48c6616d None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:38.162273 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 621/1220] 10.222.0.61 () {54 vars in 921 bytes} [Fri Aug 19 19:30:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:30:38.183882 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b325b4-85e9-41f0-a480-ecd68898d082 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:38.184209 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b325b4-85e9-41f0-a480-ecd68898d082 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:38.184419 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b325b4-85e9-41f0-a480-ecd68898d082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:38.205175 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-23b325b4-85e9-41f0-a480-ecd68898d082 None None] MFA Rules not processed for user `54c899e786614c18b2bf4334ceb2f891`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:38.207407 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-23b325b4-85e9-41f0-a480-ecd68898d082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:38.218153 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 600/1221] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Aug 19 19:30:38 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:30:38.234204 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198eaf9-cbff-4dd2-acce-051e48c6616d None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:38.249219 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198eaf9-cbff-4dd2-acce-051e48c6616d None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:38.255323 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ba2da-2867-42cc-b56c-e1c9073a8a8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:38.255919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ba2da-2867-42cc-b56c-e1c9073a8a8b service nova] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:38.256251 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ba2da-2867-42cc-b56c-e1c9073a8a8b service nova] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:38.256639 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ba2da-2867-42cc-b56c-e1c9073a8a8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:38.269277 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ba2da-2867-42cc-b56c-e1c9073a8a8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:38.271470 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ba2da-2867-42cc-b56c-e1c9073a8a8b service nova] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:38.316854 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 622/1222] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:38 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:30:45.467955 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8395f8-c4b9-4350-ae2f-27fc675ac831 None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:45.468567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8395f8-c4b9-4350-ae2f-27fc675ac831 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:45.468567 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8395f8-c4b9-4350-ae2f-27fc675ac831 None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:45.469947 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 601/1223] 10.222.0.61 () {54 vars in 921 bytes} [Fri Aug 19 19:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:30:45.581813 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15df32-9db9-4421-9b77-2d07da2e23b0 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:45.584682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15df32-9db9-4421-9b77-2d07da2e23b0 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:45.584682 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15df32-9db9-4421-9b77-2d07da2e23b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:45.604314 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-8a15df32-9db9-4421-9b77-2d07da2e23b0 None None] MFA Rules not processed for user `54c899e786614c18b2bf4334ceb2f891`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:30:45.605788 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-8a15df32-9db9-4421-9b77-2d07da2e23b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:30:45.615582 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 623/1224] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Aug 19 19:30:45 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 19:30:45.627933 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8395f8-c4b9-4350-ae2f-27fc675ac831 None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:30:45.643967 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8395f8-c4b9-4350-ae2f-27fc675ac831 None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:30:45.650734 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9416de1-ad51-4c61-97d7-f52f2bcaff62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:30:45.651814 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9416de1-ad51-4c61-97d7-f52f2bcaff62 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:30:45.652166 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9416de1-ad51-4c61-97d7-f52f2bcaff62 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:30:45.652515 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9416de1-ad51-4c61-97d7-f52f2bcaff62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:30:45.662623 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9416de1-ad51-4c61-97d7-f52f2bcaff62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:30:45.664331 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9416de1-ad51-4c61-97d7-f52f2bcaff62 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:30:45.677054 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 602/1225] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:30:45 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:30:55.599068 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=12 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:30:55.671921 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=15 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:31:03.144620 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15df32-9db9-4421-9b77-2d07da2e23b0 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:31:03.154320 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15df32-9db9-4421-9b77-2d07da2e23b0 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:31:03.157998 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e530f39-6907-44bb-9f0d-74d581bdd908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:31:03.158620 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e530f39-6907-44bb-9f0d-74d581bdd908 service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:31:03.158925 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e530f39-6907-44bb-9f0d-74d581bdd908 service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:31:03.159257 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e530f39-6907-44bb-9f0d-74d581bdd908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:31:03.168103 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e530f39-6907-44bb-9f0d-74d581bdd908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:31:03.169536 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e530f39-6907-44bb-9f0d-74d581bdd908 service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:31:03.179655 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 624/1226] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:31:03 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:31:13.174889 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=6 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:32:09.718790 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f657d9-a583-456d-a3ec-681e0f23b15f None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:09.719294 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f657d9-a583-456d-a3ec-681e0f23b15f None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:09.719391 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f657d9-a583-456d-a3ec-681e0f23b15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:09.747235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-23f657d9-a583-456d-a3ec-681e0f23b15f None None] MFA Rules not processed for user `e722f1a4b82549408a34423bd1a6a5b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:32:09.748422 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-23f657d9-a583-456d-a3ec-681e0f23b15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:32:09.774848 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 603/1227] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:32:09 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:32:10.074157 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658d2ef-e29a-43f7-822c-58881fce6e0e None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:10.074665 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658d2ef-e29a-43f7-822c-58881fce6e0e None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:10.074745 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658d2ef-e29a-43f7-822c-58881fce6e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:10.130744 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-9658d2ef-e29a-43f7-822c-58881fce6e0e None None] MFA Rules not processed for user `84bd0bde9a164516a26768a3eb44fdec`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:32:10.134976 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-9658d2ef-e29a-43f7-822c-58881fce6e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:32:10.163598 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 625/1228] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Aug 19 19:32:10 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:32:10.175459 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f657d9-a583-456d-a3ec-681e0f23b15f None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:32:10.184697 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f657d9-a583-456d-a3ec-681e0f23b15f None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:32:10.190802 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a170b2-955a-4de5-941f-c725a3ef305b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:32:10.190802 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a170b2-955a-4de5-941f-c725a3ef305b service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:10.190802 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a170b2-955a-4de5-941f-c725a3ef305b service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:10.190802 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a170b2-955a-4de5-941f-c725a3ef305b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:10.196770 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a170b2-955a-4de5-941f-c725a3ef305b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:32:10.198199 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a170b2-955a-4de5-941f-c725a3ef305b service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:32:10.205740 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 604/1229] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:32:10 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:32:20.160738 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=28 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:32:20.202496 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=21 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:32:47.785876 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51602e-ca8e-4d1f-aa2d-5eedc4d68ad3 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:32:47.786370 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51602e-ca8e-4d1f-aa2d-5eedc4d68ad3 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:32:47.786459 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51602e-ca8e-4d1f-aa2d-5eedc4d68ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:32:47.805495 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-bd51602e-ca8e-4d1f-aa2d-5eedc4d68ad3 None None] MFA Rules not processed for user `e722f1a4b82549408a34423bd1a6a5b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:32:47.806864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-bd51602e-ca8e-4d1f-aa2d-5eedc4d68ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:32:47.813647 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 626/1230] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:32:47 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:32:57.800759 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=3 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:33:05.682289 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0838d-4ad8-411f-bae6-7429820b355a None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:05.682833 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0838d-4ad8-411f-bae6-7429820b355a None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:05.682920 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0838d-4ad8-411f-bae6-7429820b355a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:05.702287 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-dbd0838d-4ad8-411f-bae6-7429820b355a None None] MFA Rules not processed for user `e722f1a4b82549408a34423bd1a6a5b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:33:05.703736 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-dbd0838d-4ad8-411f-bae6-7429820b355a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:33:05.710802 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 605/1231] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:33:05 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:33:15.697478 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:33:29.794504 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51602e-ca8e-4d1f-aa2d-5eedc4d68ad3 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:33:29.825749 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51602e-ca8e-4d1f-aa2d-5eedc4d68ad3 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:33:29.830971 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92e385-919e-4741-aca2-37c6a8df4196 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aab18dc39cf4d119ba5f07fda334ec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:33:29.836204 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92e385-919e-4741-aca2-37c6a8df4196 service placement] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:33:29.836204 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92e385-919e-4741-aca2-37c6a8df4196 service placement] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:33:29.836204 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92e385-919e-4741-aca2-37c6a8df4196 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:33:29.841137 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92e385-919e-4741-aca2-37c6a8df4196 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:33:29.842983 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92e385-919e-4741-aca2-37c6a8df4196 service placement] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:33:29.853441 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 627/1232] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:33:29 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:33:39.849119 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=13 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:34:30.157053 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a31106-5d41-4362-ad75-60cb7f69a429 None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:34:30.157551 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a31106-5d41-4362-ad75-60cb7f69a429 None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:34:30.157646 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a31106-5d41-4362-ad75-60cb7f69a429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:34:30.177431 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-27a31106-5d41-4362-ad75-60cb7f69a429 None None] MFA Rules not processed for user `e722f1a4b82549408a34423bd1a6a5b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:34:30.178655 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-27a31106-5d41-4362-ad75-60cb7f69a429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:34:30.185423 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 606/1233] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:34:30 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:34:40.170824 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=3 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:34:45.628568 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92e385-919e-4741-aca2-37c6a8df4196 service placement] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:34:45.638403 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92e385-919e-4741-aca2-37c6a8df4196 service placement] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:34:45.642921 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe9562-589d-43f8-b8f4-7cbca33b0882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:34:45.643520 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe9562-589d-43f8-b8f4-7cbca33b0882 service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:34:45.643794 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe9562-589d-43f8-b8f4-7cbca33b0882 service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:34:45.644064 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe9562-589d-43f8-b8f4-7cbca33b0882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:34:45.653155 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe9562-589d-43f8-b8f4-7cbca33b0882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:34:45.654604 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe9562-589d-43f8-b8f4-7cbca33b0882 service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:34:45.664628 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 628/1234] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:34:45 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:34:48.039950 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fd849-03ff-46be-a841-78c2ba0fcaba None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:34:48.040554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fd849-03ff-46be-a841-78c2ba0fcaba None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:34:48.040554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fd849-03ff-46be-a841-78c2ba0fcaba None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:34:48.041873 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 607/1235] 10.222.0.61 () {54 vars in 921 bytes} [Fri Aug 19 19:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:34:48.048125 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fbda4-e39c-4c72-953f-784a8a494bd3 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:34:48.048622 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fbda4-e39c-4c72-953f-784a8a494bd3 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:34:48.048865 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fbda4-e39c-4c72-953f-784a8a494bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:34:48.102075 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-621fbda4-e39c-4c72-953f-784a8a494bd3 None None] MFA Rules not processed for user `54c899e786614c18b2bf4334ceb2f891`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:34:48.103496 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-621fbda4-e39c-4c72-953f-784a8a494bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:34:48.123718 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 629/1236] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Aug 19 19:34:48 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:34:48.137058 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fd849-03ff-46be-a841-78c2ba0fcaba None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:34:48.151860 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fd849-03ff-46be-a841-78c2ba0fcaba None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:34:48.157616 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaef51e-be0b-4fb6-a0d5-ac8f2a5b4e76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:34:48.158235 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaef51e-be0b-4fb6-a0d5-ac8f2a5b4e76 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:34:48.158502 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaef51e-be0b-4fb6-a0d5-ac8f2a5b4e76 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:34:48.158872 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaef51e-be0b-4fb6-a0d5-ac8f2a5b4e76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:34:48.167776 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaef51e-be0b-4fb6-a0d5-ac8f2a5b4e76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:34:48.169362 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaef51e-be0b-4fb6-a0d5-ac8f2a5b4e76 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:34:48.180059 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 608/1237] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:34:48 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:34:58.120653 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=24 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:34:58.175711 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=6 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:35:31.431922 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fbda4-e39c-4c72-953f-784a8a494bd3 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:31.443540 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fbda4-e39c-4c72-953f-784a8a494bd3 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:31.449212 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e3078-e1b3-400b-9697-1c8a52bc7ae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:31.450306 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e3078-e1b3-400b-9697-1c8a52bc7ae0 service nova] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:31.450306 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e3078-e1b3-400b-9697-1c8a52bc7ae0 service nova] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:31.450514 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e3078-e1b3-400b-9697-1c8a52bc7ae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:31.459602 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e3078-e1b3-400b-9697-1c8a52bc7ae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:31.461214 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e3078-e1b3-400b-9697-1c8a52bc7ae0 service nova] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:31.470450 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 630/1238] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:35:31 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:35:31.524199 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaef51e-be0b-4fb6-a0d5-ac8f2a5b4e76 service nova] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:31.533753 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaef51e-be0b-4fb6-a0d5-ac8f2a5b4e76 service nova] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:31.545760 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634c8c6-0a5b-413f-b39a-986056034fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:31.549015 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634c8c6-0a5b-413f-b39a-986056034fbd service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:31.549015 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634c8c6-0a5b-413f-b39a-986056034fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:31.549015 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634c8c6-0a5b-413f-b39a-986056034fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:31.558189 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634c8c6-0a5b-413f-b39a-986056034fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:31.559668 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634c8c6-0a5b-413f-b39a-986056034fbd service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:31.571501 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 609/1239] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:35:31 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:35:33.829325 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e3078-e1b3-400b-9697-1c8a52bc7ae0 service nova] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:33.906012 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e3078-e1b3-400b-9697-1c8a52bc7ae0 service nova] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:33.911255 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc8dc1-d326-4ec1-a433-81b9a1166685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23bbd8bfe6924ea2a6fd35513f830cb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:33.912135 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc8dc1-d326-4ec1-a433-81b9a1166685 service cinder] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:33.912420 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc8dc1-d326-4ec1-a433-81b9a1166685 service cinder] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:33.912698 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc8dc1-d326-4ec1-a433-81b9a1166685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:33.927052 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc8dc1-d326-4ec1-a433-81b9a1166685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:33.928537 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc8dc1-d326-4ec1-a433-81b9a1166685 service cinder] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:33.945574 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 631/1240] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:35:33 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:35:41.565985 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=6 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:35:43.939429 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=36 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:35:45.884632 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634c8c6-0a5b-413f-b39a-986056034fbd service neutron] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:45.895399 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634c8c6-0a5b-413f-b39a-986056034fbd service neutron] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:45.901744 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b7b85-74fd-423d-934e-d2a1b7efe42c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:45.902377 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b7b85-74fd-423d-934e-d2a1b7efe42c service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:45.902688 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b7b85-74fd-423d-934e-d2a1b7efe42c service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:45.902956 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b7b85-74fd-423d-934e-d2a1b7efe42c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:45.912302 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b7b85-74fd-423d-934e-d2a1b7efe42c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:45.913894 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b7b85-74fd-423d-934e-d2a1b7efe42c service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:45.923863 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 610/1241] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:35:45 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:35:55.919883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=6 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:35:56.865348 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84a6aa-b8f7-45bd-9a29-aee291791de6 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:56.865853 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84a6aa-b8f7-45bd-9a29-aee291791de6 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:56.865947 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84a6aa-b8f7-45bd-9a29-aee291791de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:56.885086 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-ed84a6aa-b8f7-45bd-9a29-aee291791de6 None None] MFA Rules not processed for user `796e2eff2b57416686cbe9be13c772e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:35:56.886290 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-ed84a6aa-b8f7-45bd-9a29-aee291791de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:35:56.893298 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 632/1242] 10.222.0.61 () {58 vars in 958 bytes} [Fri Aug 19 19:35:56 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:35:57.604254 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b7b85-74fd-423d-934e-d2a1b7efe42c service nova] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:35:57.618371 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b7b85-74fd-423d-934e-d2a1b7efe42c service nova] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:35:57.625515 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb974b5e-c9b9-4c2f-bca8-1361b7ea5769 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aab18dc39cf4d119ba5f07fda334ec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:35:57.626721 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb974b5e-c9b9-4c2f-bca8-1361b7ea5769 service placement] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:35:57.627280 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb974b5e-c9b9-4c2f-bca8-1361b7ea5769 service placement] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:35:57.627858 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb974b5e-c9b9-4c2f-bca8-1361b7ea5769 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:35:57.638939 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb974b5e-c9b9-4c2f-bca8-1361b7ea5769 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:35:57.640522 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb974b5e-c9b9-4c2f-bca8-1361b7ea5769 service placement] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:35:57.650752 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 611/1243] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:35:57 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:36:06.879314 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=3 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:36:07.646221 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=6 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:36:10.730769 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84a6aa-b8f7-45bd-9a29-aee291791de6 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:36:10.740374 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84a6aa-b8f7-45bd-9a29-aee291791de6 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:36:10.744033 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316b8f2-25c7-4d03-8b18-9fcde06a03b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:36:10.744633 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316b8f2-25c7-4d03-8b18-9fcde06a03b5 service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:36:10.744912 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316b8f2-25c7-4d03-8b18-9fcde06a03b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:36:10.745182 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316b8f2-25c7-4d03-8b18-9fcde06a03b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:36:10.752487 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316b8f2-25c7-4d03-8b18-9fcde06a03b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:36:10.753913 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316b8f2-25c7-4d03-8b18-9fcde06a03b5 service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:36:10.761828 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 633/1244] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:36:10 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:36:19.122980 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb974b5e-c9b9-4c2f-bca8-1361b7ea5769 service placement] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:36:19.134083 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb974b5e-c9b9-4c2f-bca8-1361b7ea5769 service placement] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:36:19.139213 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20663007-b6e8-46e9-8649-59bfc82b90fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:36:19.139802 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20663007-b6e8-46e9-8649-59bfc82b90fe service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:36:19.140072 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20663007-b6e8-46e9-8649-59bfc82b90fe service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:36:19.140336 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20663007-b6e8-46e9-8649-59bfc82b90fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:36:19.148444 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20663007-b6e8-46e9-8649-59bfc82b90fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:36:19.155656 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20663007-b6e8-46e9-8649-59bfc82b90fe service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:36:19.159554 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 612/1245] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:36:19 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:36:20.758347 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=6 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:36:29.155677 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=6 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:36:31.185204 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316b8f2-25c7-4d03-8b18-9fcde06a03b5 service neutron] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:36:31.193534 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316b8f2-25c7-4d03-8b18-9fcde06a03b5 service neutron] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:36:31.197044 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17baf1b-3a59-4f1e-a01b-bcb990b96e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:36:31.197626 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17baf1b-3a59-4f1e-a01b-bcb990b96e1d service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:36:31.198217 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17baf1b-3a59-4f1e-a01b-bcb990b96e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:36:31.198488 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17baf1b-3a59-4f1e-a01b-bcb990b96e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:36:31.207689 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17baf1b-3a59-4f1e-a01b-bcb990b96e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:36:31.209104 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17baf1b-3a59-4f1e-a01b-bcb990b96e1d service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:36:31.219180 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 634/1246] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:36:31 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:36:41.214675 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=6 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:38:06.854919 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20663007-b6e8-46e9-8649-59bfc82b90fe service nova] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:38:06.865367 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20663007-b6e8-46e9-8649-59bfc82b90fe service nova] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:38:06.870264 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e63b2-0a16-4893-af54-fb070a7f6309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c899e786614c18b2bf4334ceb2f891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:38:06.876148 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e63b2-0a16-4893-af54-fb070a7f6309 service nova] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:38:06.876148 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e63b2-0a16-4893-af54-fb070a7f6309 service nova] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:38:06.876148 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e63b2-0a16-4893-af54-fb070a7f6309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:38:06.879768 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e63b2-0a16-4893-af54-fb070a7f6309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:38:06.881368 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e63b2-0a16-4893-af54-fb070a7f6309 service nova] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:38:06.890746 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 613/1247] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:38:06 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:38:16.886073 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=6 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:38:21.098071 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17baf1b-3a59-4f1e-a01b-bcb990b96e1d service neutron] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:38:21.106591 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17baf1b-3a59-4f1e-a01b-bcb990b96e1d service neutron] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:38:21.110397 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486d8ee-1a42-47c0-9506-c1a729ab976b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:38:21.111024 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486d8ee-1a42-47c0-9506-c1a729ab976b service neutron] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:38:21.111303 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486d8ee-1a42-47c0-9506-c1a729ab976b service neutron] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:38:21.111573 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486d8ee-1a42-47c0-9506-c1a729ab976b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:38:21.182949 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486d8ee-1a42-47c0-9506-c1a729ab976b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:38:21.184397 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486d8ee-1a42-47c0-9506-c1a729ab976b service neutron] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:38:21.204223 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 635/1248] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:38:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:38:25.009182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96dbd4-15e1-41ac-a574-2faff2fa016c None None] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:38:25.012328 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96dbd4-15e1-41ac-a574-2faff2fa016c None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:38:25.012328 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96dbd4-15e1-41ac-a574-2faff2fa016c None None] PATH_INFO: `/` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:38:25.012328 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 614/1249] 10.222.0.61 () {54 vars in 921 bytes} [Fri Aug 19 19:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:38:25.021511 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041deee-da5b-4e78-bbee-09f37f56fe37 None None] REQUEST_METHOD: `POST` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:38:25.021964 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041deee-da5b-4e78-bbee-09f37f56fe37 None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:38:25.022049 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041deee-da5b-4e78-bbee-09f37f56fe37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:38:25.073591 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.auth.core [None req-c041deee-da5b-4e78-bbee-09f37f56fe37 None None] MFA Rules not processed for user `4aab18dc39cf4d119ba5f07fda334ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=88347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:38:25.075067 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-c041deee-da5b-4e78-bbee-09f37f56fe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:38:25.086038 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 636/1250] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Aug 19 19:38:25 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:38:25.097286 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96dbd4-15e1-41ac-a574-2faff2fa016c None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:38:25.099120 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-6d96dbd4-15e1-41ac-a574-2faff2fa016c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:38:25.115683 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96dbd4-15e1-41ac-a574-2faff2fa016c None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:38:25.120786 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcca5da-b5f4-4e36-a967-f341ba533019 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aab18dc39cf4d119ba5f07fda334ec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:38:25.121379 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcca5da-b5f4-4e36-a967-f341ba533019 service placement] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:38:25.121687 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcca5da-b5f4-4e36-a967-f341ba533019 service placement] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:38:25.121961 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcca5da-b5f4-4e36-a967-f341ba533019 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:38:25.133101 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcca5da-b5f4-4e36-a967-f341ba533019 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:38:25.139129 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcca5da-b5f4-4e36-a967-f341ba533019 service placement] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:38:25.147949 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 615/1251] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:38:25 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:38:28.865364 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041deee-da5b-4e78-bbee-09f37f56fe37 None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:38:28.877497 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041deee-da5b-4e78-bbee-09f37f56fe37 None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:38:28.882054 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c92598-7f9a-4984-b1dd-6a8bc17409db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:38:28.882875 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c92598-7f9a-4984-b1dd-6a8bc17409db admin admin] REQUEST_METHOD: `DELETE` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:38:28.883150 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c92598-7f9a-4984-b1dd-6a8bc17409db admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:38:28.883416 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c92598-7f9a-4984-b1dd-6a8bc17409db admin admin] PATH_INFO: `/v3/users/e722f1a4b82549408a34423bd1a6a5b6` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:38:28.884522 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c92598-7f9a-4984-b1dd-6a8bc17409db admin admin] RBAC: Authorizing `identity:delete_user(user_id=e722f1a4b82549408a34423bd1a6a5b6)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:38:28.885730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: WARNING py.warnings [None req-b2c92598-7f9a-4984-b1dd-6a8bc17409db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:38:28.885730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: warnings.warn(msg) Aug 19 19:38:28.885730 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: Aug 19 19:38:28.886968 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c92598-7f9a-4984-b1dd-6a8bc17409db admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:38:29.067832 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-b2c92598-7f9a-4984-b1dd-6a8bc17409db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e722f1a4b82549408a34423bd1a6a5b6'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:29.068551 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-b2c92598-7f9a-4984-b1dd-6a8bc17409db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e722f1a4b82549408a34423bd1a6a5b6'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:29.155552 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-b2c92598-7f9a-4984-b1dd-6a8bc17409db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e722f1a4b82549408a34423bd1a6a5b6'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:29.174612 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-b2c92598-7f9a-4984-b1dd-6a8bc17409db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e722f1a4b82549408a34423bd1a6a5b6'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:29.175298 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-b2c92598-7f9a-4984-b1dd-6a8bc17409db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e722f1a4b82549408a34423bd1a6a5b6'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:29.190783 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 637/1252] 10.222.0.61 () {58 vars in 1224 bytes} [Fri Aug 19 19:38:28 2022] DELETE /identity/v3/users/e722f1a4b82549408a34423bd1a6a5b6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:38:29.453844 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcca5da-b5f4-4e36-a967-f341ba533019 service placement] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:38:29.465829 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcca5da-b5f4-4e36-a967-f341ba533019 service placement] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:38:29.524518 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:38:29.525171 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:38:29.525471 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:38:29.525742 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea admin admin] PATH_INFO: `/v3/projects/0b9945a2d9a84d71b7f496124430f0fa` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:38:29.526883 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b9945a2d9a84d71b7f496124430f0fa)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:38:29.527952 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: WARNING py.warnings [None req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 19:38:29.527952 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: warnings.warn(msg) Aug 19 19:38:29.527952 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: Aug 19 19:38:29.529169 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:38:29.639807 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b9945a2d9a84d71b7f496124430f0fa', 'request_id': 'req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:29.646022 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b9945a2d9a84d71b7f496124430f0fa', 'request_id': 'req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:29.717835 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b9945a2d9a84d71b7f496124430f0fa', 'request_id': 'req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:29.749450 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea admin admin] The token cache is being invalidate because project 0b9945a2d9a84d71b7f496124430f0fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 19:38:29.749734 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:29.750388 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:29.751919 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 616/1253] 10.222.0.61 () {58 vars in 1233 bytes} [Fri Aug 19 19:38:29 2022] DELETE /identity/v3/projects/0b9945a2d9a84d71b7f496124430f0fa => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:38:29.756009 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c92598-7f9a-4984-b1dd-6a8bc17409db admin admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:38:29.757545 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-b2c92598-7f9a-4984-b1dd-6a8bc17409db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:38:29.771481 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c92598-7f9a-4984-b1dd-6a8bc17409db admin admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:38:29.783836 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:38:29.829119 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eec47f-5747-4d5a-b7ee-4e34a5b96835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:38:29.829832 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eec47f-5747-4d5a-b7ee-4e34a5b96835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:38:29.830078 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eec47f-5747-4d5a-b7ee-4e34a5b96835 admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:38:29.830346 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eec47f-5747-4d5a-b7ee-4e34a5b96835 admin admin] PATH_INFO: `/v3/users/549cfc4089e14e22aa91b8199ccbe8fa` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:38:29.831479 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eec47f-5747-4d5a-b7ee-4e34a5b96835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=549cfc4089e14e22aa91b8199ccbe8fa)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:38:29.833402 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eec47f-5747-4d5a-b7ee-4e34a5b96835 admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:38:30.021810 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-94eec47f-5747-4d5a-b7ee-4e34a5b96835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549cfc4089e14e22aa91b8199ccbe8fa'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:30.022443 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-94eec47f-5747-4d5a-b7ee-4e34a5b96835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549cfc4089e14e22aa91b8199ccbe8fa'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:30.083177 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-94eec47f-5747-4d5a-b7ee-4e34a5b96835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549cfc4089e14e22aa91b8199ccbe8fa'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:30.095957 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-94eec47f-5747-4d5a-b7ee-4e34a5b96835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549cfc4089e14e22aa91b8199ccbe8fa'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:30.096585 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-94eec47f-5747-4d5a-b7ee-4e34a5b96835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549cfc4089e14e22aa91b8199ccbe8fa'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:30.109581 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 638/1254] 10.222.0.61 () {58 vars in 1224 bytes} [Fri Aug 19 19:38:29 2022] DELETE /identity/v3/users/549cfc4089e14e22aa91b8199ccbe8fa => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:38:30.351121 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:38:30.352673 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:38:30.369064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e4d2d-d9e1-44dc-870d-6d242d947aea admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:38:30.427182 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d364b7-9e02-44eb-8efe-d969dfd5a176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:38:30.427810 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d364b7-9e02-44eb-8efe-d969dfd5a176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:38:30.428084 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d364b7-9e02-44eb-8efe-d969dfd5a176 admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:38:30.428356 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d364b7-9e02-44eb-8efe-d969dfd5a176 admin admin] PATH_INFO: `/v3/projects/acb5e6ab7b1244579f9f23981b56ab97` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:38:30.429556 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d364b7-9e02-44eb-8efe-d969dfd5a176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb5e6ab7b1244579f9f23981b56ab97)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:38:30.431556 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d364b7-9e02-44eb-8efe-d969dfd5a176 admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:38:30.439519 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:38:30.594063 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f8d364b7-9e02-44eb-8efe-d969dfd5a176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb5e6ab7b1244579f9f23981b56ab97', 'request_id': 'req-f8d364b7-9e02-44eb-8efe-d969dfd5a176'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:30.599487 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f8d364b7-9e02-44eb-8efe-d969dfd5a176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb5e6ab7b1244579f9f23981b56ab97', 'request_id': 'req-f8d364b7-9e02-44eb-8efe-d969dfd5a176'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:30.720334 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f8d364b7-9e02-44eb-8efe-d969dfd5a176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb5e6ab7b1244579f9f23981b56ab97', 'request_id': 'req-f8d364b7-9e02-44eb-8efe-d969dfd5a176'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:30.732009 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f8d364b7-9e02-44eb-8efe-d969dfd5a176 admin admin] The token cache is being invalidate because project acb5e6ab7b1244579f9f23981b56ab97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 19:38:30.732303 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f8d364b7-9e02-44eb-8efe-d969dfd5a176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:30.732943 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-f8d364b7-9e02-44eb-8efe-d969dfd5a176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:38:30.734401 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 617/1255] 10.222.0.61 () {58 vars in 1233 bytes} [Fri Aug 19 19:38:30 2022] DELETE /identity/v3/projects/acb5e6ab7b1244579f9f23981b56ab97 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:38:40.105409 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:38:40.729028 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:38:56.050069 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eec47f-5747-4d5a-b7ee-4e34a5b96835 admin admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:38:56.051558 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-94eec47f-5747-4d5a-b7ee-4e34a5b96835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:38:56.128072 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eec47f-5747-4d5a-b7ee-4e34a5b96835 admin admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:38:56.186201 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2570a-fd32-46f7-aec7-4ad240ba3fcf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aab18dc39cf4d119ba5f07fda334ec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:38:56.186994 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2570a-fd32-46f7-aec7-4ad240ba3fcf service placement] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:38:56.187271 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2570a-fd32-46f7-aec7-4ad240ba3fcf service placement] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:38:56.187544 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2570a-fd32-46f7-aec7-4ad240ba3fcf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:38:56.189307 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-9fd2570a-fd32-46f7-aec7-4ad240ba3fcf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:38:56.200643 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2570a-fd32-46f7-aec7-4ad240ba3fcf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:38:56.202437 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2570a-fd32-46f7-aec7-4ad240ba3fcf service placement] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:38:56.212170 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 639/1256] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:38:56 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:38:59.487056 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d364b7-9e02-44eb-8efe-d969dfd5a176 admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:38:59.488652 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-f8d364b7-9e02-44eb-8efe-d969dfd5a176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:38:59.558246 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d364b7-9e02-44eb-8efe-d969dfd5a176 admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:38:59.563020 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdec719-e2de-4a61-93dc-1abadacbe879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84bd0bde9a164516a26768a3eb44fdec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:38:59.563628 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdec719-e2de-4a61-93dc-1abadacbe879 service neutron] REQUEST_METHOD: `GET` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:38:59.563906 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdec719-e2de-4a61-93dc-1abadacbe879 service neutron] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:38:59.564180 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdec719-e2de-4a61-93dc-1abadacbe879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:38:59.566018 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-dbdec719-e2de-4a61-93dc-1abadacbe879 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:38:59.633559 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdec719-e2de-4a61-93dc-1abadacbe879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:38:59.635064 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdec719-e2de-4a61-93dc-1abadacbe879 service neutron] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:38:59.644890 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 618/1257] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:38:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:39:03.178382 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6d1e0-5945-4b61-8c61-67fb4726011b None None] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:39:03.178919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6d1e0-5945-4b61-8c61-67fb4726011b None None] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:39:03.178919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6d1e0-5945-4b61-8c61-67fb4726011b None None] PATH_INFO: `/` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:39:03.180310 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 640/1258] 10.222.0.61 () {54 vars in 921 bytes} [Fri Aug 19 19:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 19:39:03.191066 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3added98-9035-4633-8d64-7f0c1c78fe3d None None] REQUEST_METHOD: `POST` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:39:03.191558 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3added98-9035-4633-8d64-7f0c1c78fe3d None None] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:39:03.191664 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3added98-9035-4633-8d64-7f0c1c78fe3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:39:03.211917 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.auth.core [None req-3added98-9035-4633-8d64-7f0c1c78fe3d None None] MFA Rules not processed for user `4aab18dc39cf4d119ba5f07fda334ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=88346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 19:39:03.213139 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3added98-9035-4633-8d64-7f0c1c78fe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:39:03.222371 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 619/1259] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Aug 19 19:39:03 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 19:39:03.239509 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6d1e0-5945-4b61-8c61-67fb4726011b None None] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:39:03.248386 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-e2a6d1e0-5945-4b61-8c61-67fb4726011b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:39:03.258488 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6d1e0-5945-4b61-8c61-67fb4726011b None None] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:39:03.263662 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855574b-52a5-4832-86d7-178a8161b8f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aab18dc39cf4d119ba5f07fda334ec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '409a043500554125a93c4636db5a6812', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:39:03.264919 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855574b-52a5-4832-86d7-178a8161b8f8 service placement] REQUEST_METHOD: `GET` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:39:03.265207 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855574b-52a5-4832-86d7-178a8161b8f8 service placement] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:39:03.265492 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855574b-52a5-4832-86d7-178a8161b8f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:39:03.273652 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855574b-52a5-4832-86d7-178a8161b8f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:39:03.275279 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855574b-52a5-4832-86d7-178a8161b8f8 service placement] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:39:03.285452 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 641/1260] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Aug 19 19:39:03 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 19:39:06.875876 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3added98-9035-4633-8d64-7f0c1c78fe3d None None] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:39:06.880425 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-3added98-9035-4633-8d64-7f0c1c78fe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:39:06.892103 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3added98-9035-4633-8d64-7f0c1c78fe3d None None] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:39:06.896577 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e1f71-ae19-476f-863b-e24d9348e28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:39:06.897205 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e1f71-ae19-476f-863b-e24d9348e28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:39:06.897480 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e1f71-ae19-476f-863b-e24d9348e28c admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:39:06.897747 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e1f71-ae19-476f-863b-e24d9348e28c admin admin] PATH_INFO: `/v3/users/796e2eff2b57416686cbe9be13c772e8` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:39:06.898890 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e1f71-ae19-476f-863b-e24d9348e28c admin admin] RBAC: Authorizing `identity:delete_user(user_id=796e2eff2b57416686cbe9be13c772e8)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:39:06.900811 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e1f71-ae19-476f-863b-e24d9348e28c admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:39:07.087537 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ba3e1f71-ae19-476f-863b-e24d9348e28c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '796e2eff2b57416686cbe9be13c772e8'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:07.157037 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ba3e1f71-ae19-476f-863b-e24d9348e28c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '796e2eff2b57416686cbe9be13c772e8'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:07.169911 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ba3e1f71-ae19-476f-863b-e24d9348e28c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '796e2eff2b57416686cbe9be13c772e8'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:07.171268 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ba3e1f71-ae19-476f-863b-e24d9348e28c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '796e2eff2b57416686cbe9be13c772e8'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:07.171884 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-ba3e1f71-ae19-476f-863b-e24d9348e28c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '796e2eff2b57416686cbe9be13c772e8'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:07.184032 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 620/1261] 10.222.0.61 () {58 vars in 1224 bytes} [Fri Aug 19 19:39:06 2022] DELETE /identity/v3/users/796e2eff2b57416686cbe9be13c772e8 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:39:07.477207 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855574b-52a5-4832-86d7-178a8161b8f8 service placement] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:39:07.492672 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855574b-52a5-4832-86d7-178a8161b8f8 service placement] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:39:07.586326 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548bf15-83bf-4c29-b717-46a7b591f6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:39:07.587115 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548bf15-83bf-4c29-b717-46a7b591f6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:39:07.587390 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548bf15-83bf-4c29-b717-46a7b591f6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:39:07.587787 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548bf15-83bf-4c29-b717-46a7b591f6d1 admin admin] PATH_INFO: `/v3/projects/dabc9e7ae707469f8eb643d854bcdd7c` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:39:07.589674 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548bf15-83bf-4c29-b717-46a7b591f6d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dabc9e7ae707469f8eb643d854bcdd7c)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:39:07.593118 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548bf15-83bf-4c29-b717-46a7b591f6d1 admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:39:07.621886 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:SELECT=100 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:39:07.705448 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-8548bf15-83bf-4c29-b717-46a7b591f6d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dabc9e7ae707469f8eb643d854bcdd7c', 'request_id': 'req-8548bf15-83bf-4c29-b717-46a7b591f6d1'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:07.794603 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-8548bf15-83bf-4c29-b717-46a7b591f6d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dabc9e7ae707469f8eb643d854bcdd7c', 'request_id': 'req-8548bf15-83bf-4c29-b717-46a7b591f6d1'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:07.807207 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-8548bf15-83bf-4c29-b717-46a7b591f6d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dabc9e7ae707469f8eb643d854bcdd7c', 'request_id': 'req-8548bf15-83bf-4c29-b717-46a7b591f6d1'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:07.821322 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-8548bf15-83bf-4c29-b717-46a7b591f6d1 admin admin] The token cache is being invalidate because project dabc9e7ae707469f8eb643d854bcdd7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 19:39:07.821610 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-8548bf15-83bf-4c29-b717-46a7b591f6d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:07.822440 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-8548bf15-83bf-4c29-b717-46a7b591f6d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:07.825248 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 642/1262] 10.222.0.61 () {58 vars in 1233 bytes} [Fri Aug 19 19:39:07 2022] DELETE /identity/v3/projects/dabc9e7ae707469f8eb643d854bcdd7c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:39:07.830217 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e1f71-ae19-476f-863b-e24d9348e28c admin admin] Authenticating user token {{(pid=88346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:39:07.831728 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.fernet_utils [None req-ba3e1f71-ae19-476f-863b-e24d9348e28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:39:07.845617 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:39:07.850255 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e1f71-ae19-476f-863b-e24d9348e28c admin admin] Validating token access rules against request {{(pid=88346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:39:07.921912 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c77000-fe47-4f71-82e4-a6e9690d95cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:39:07.922950 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c77000-fe47-4f71-82e4-a6e9690d95cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:39:07.923407 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c77000-fe47-4f71-82e4-a6e9690d95cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:39:07.923871 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c77000-fe47-4f71-82e4-a6e9690d95cb admin admin] PATH_INFO: `/v3/users/3a4a08ef712c433e97e07ab2e94695a9` {{(pid=88346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:39:07.925647 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c77000-fe47-4f71-82e4-a6e9690d95cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a4a08ef712c433e97e07ab2e94695a9)` {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:39:07.929085 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c77000-fe47-4f71-82e4-a6e9690d95cb admin admin] RBAC: Authorization granted {{(pid=88346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:39:08.164281 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c1c77000-fe47-4f71-82e4-a6e9690d95cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a4a08ef712c433e97e07ab2e94695a9'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:08.234784 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c1c77000-fe47-4f71-82e4-a6e9690d95cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a4a08ef712c433e97e07ab2e94695a9'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:08.248395 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c1c77000-fe47-4f71-82e4-a6e9690d95cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a4a08ef712c433e97e07ab2e94695a9'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:08.250806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c1c77000-fe47-4f71-82e4-a6e9690d95cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a4a08ef712c433e97e07ab2e94695a9'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:08.250806 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG keystone.notifications [None req-c1c77000-fe47-4f71-82e4-a6e9690d95cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a4a08ef712c433e97e07ab2e94695a9'} {{(pid=88346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:08.266103 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: [pid: 88346|app: 0|req: 621/1263] 10.222.0.61 () {58 vars in 1224 bytes} [Fri Aug 19 19:39:07 2022] DELETE /identity/v3/users/3a4a08ef712c433e97e07ab2e94695a9 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:39:08.510662 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548bf15-83bf-4c29-b717-46a7b591f6d1 admin admin] Authenticating user token {{(pid=88347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 19:39:08.512147 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.fernet_utils [None req-8548bf15-83bf-4c29-b717-46a7b591f6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 19:39:08.525209 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548bf15-83bf-4c29-b717-46a7b591f6d1 admin admin] Validating token access rules against request {{(pid=88347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 19:39:08.584864 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc379d-6df4-4a09-be5d-c8ca54a32dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffe86579b7344d19702549b20bcc927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1351328a9fb54f3696993b85a91b70f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 19:39:08.585573 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc379d-6df4-4a09-be5d-c8ca54a32dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 19:39:08.585848 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc379d-6df4-4a09-be5d-c8ca54a32dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 19:39:08.586117 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc379d-6df4-4a09-be5d-c8ca54a32dcc admin admin] PATH_INFO: `/v3/projects/0d793d4c7903488fafdaa791894056fd` {{(pid=88347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 19:39:08.587250 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc379d-6df4-4a09-be5d-c8ca54a32dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d793d4c7903488fafdaa791894056fd)` {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 19:39:08.589143 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc379d-6df4-4a09-be5d-c8ca54a32dcc admin admin] RBAC: Authorization granted {{(pid=88347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 19:39:08.683583 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-a7bc379d-6df4-4a09-be5d-c8ca54a32dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d793d4c7903488fafdaa791894056fd', 'request_id': 'req-a7bc379d-6df4-4a09-be5d-c8ca54a32dcc'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:08.759317 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-a7bc379d-6df4-4a09-be5d-c8ca54a32dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d793d4c7903488fafdaa791894056fd', 'request_id': 'req-a7bc379d-6df4-4a09-be5d-c8ca54a32dcc'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:08.766490 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-a7bc379d-6df4-4a09-be5d-c8ca54a32dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d793d4c7903488fafdaa791894056fd', 'request_id': 'req-a7bc379d-6df4-4a09-be5d-c8ca54a32dcc'} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:08.776784 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-a7bc379d-6df4-4a09-be5d-c8ca54a32dcc admin admin] The token cache is being invalidate because project 0d793d4c7903488fafdaa791894056fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 19:39:08.777065 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-a7bc379d-6df4-4a09-be5d-c8ca54a32dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:08.777701 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG keystone.notifications [None req-a7bc379d-6df4-4a09-be5d-c8ca54a32dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 19:39:08.779228 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: [pid: 88347|app: 0|req: 643/1264] 10.222.0.61 () {58 vars in 1233 bytes} [Fri Aug 19 19:39:08 2022] DELETE /identity/v3/projects/0d793d4c7903488fafdaa791894056fd => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 19:39:18.259089 dv-osbrick-849019-5-ceph devstack@keystone.service[88346]: DEBUG dbcounter [-] [88346] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 19:39:18.773797 dv-osbrick-849019-5-ceph devstack@keystone.service[88347]: DEBUG dbcounter [-] [88347] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=88347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}